-- Logs begin at Thu 2022-06-23 10:17:18 UTC, end at Thu 2022-06-23 11:21:00 UTC. -- Jun 23 10:53:39.390848 dv-cinder-843309-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 10:53:39.399935 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 10:53:39 2022] *** Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: nodename: dv-cinder-843309-2-iscsi Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: machine: x86_64 Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: clock source: unix Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: pcre jit disabled Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: detected number of CPU cores: 4 Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: current working directory: / Jun 23 10:53:39.401915 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: detected binary path: /usr/bin/uwsgi-core Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: your processes number limit is 47680 Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: your memory page size is 4096 bytes Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: detected max file descriptor number: 2048 Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: lock engine: pthread robust mutexes Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: thunder lock: enabled Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 10:53:39.402670 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 10:53:39.446347 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: Python main interpreter initialized at 0x56283b2679c0 Jun 23 10:53:39.446347 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: python threads support enabled Jun 23 10:53:39.446347 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: your server socket listen backlog is limited to 100 connections Jun 23 10:53:39.446347 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: your mercy for graceful operations on workers is 90 seconds Jun 23 10:53:39.446688 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 10:53:39.446766 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: *** Operational MODE: preforking *** Jun 23 10:53:39.447001 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: *** uWSGI is running in multiple interpreter mode *** Jun 23 10:53:39.447001 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: spawned uWSGI master process (pid: 103169) Jun 23 10:53:39.447183 dv-cinder-843309-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 10:53:39.448660 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: spawned uWSGI worker 1 (pid: 103170, cores: 1) Jun 23 10:53:39.448660 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: spawned uWSGI worker 2 (pid: 103171, cores: 1) Jun 23 10:53:39.448660 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 10:53:40.102692 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 10:53:40.103144 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 10:53:41.224650 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:53:41.224650 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes Jun 23 10:53:41.225212 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:53:41.225212 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes Jun 23 10:53:41.229373 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:53:41.229373 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes Jun 23 10:53:41.229810 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:53:41.229810 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes Jun 23 10:53:43.689343 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:53:43.689902 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:53:43.690016 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:53:43.690357 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:53:43.690450 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:53:43.690539 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:53:43.690622 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:53:43.690699 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:53:43.690965 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:53:43.691070 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.691217 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:53:43.691340 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.691601 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.691763 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.691947 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692045 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692263 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692352 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692577 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692672 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692886 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.692978 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.693197 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.693291 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.693513 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.693601 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.693767 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.693853 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694075 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694177 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694379 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694464 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-2-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694691 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694782 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.694986 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.695083 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-2-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.695286 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.695380 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.695603 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.695720 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.695921 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.696022 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.696233 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.696328 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.696528 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.696620 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.696843 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.697014 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.697146 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.697446 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.697647 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.697777 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.697952 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.698046 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.698250 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.698365 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.698558 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.698731 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.698870 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699006 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699268 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699484 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699580 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699828 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.699925 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.700143 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.700268 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.700445 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.700533 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-2-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.700750 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.700849 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.701099 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.701186 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-2-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.701404 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.701505 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.701730 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.701812 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.702039 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.702162 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.702407 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.702506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.702725 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.702868 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703041 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703129 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703343 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703430 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703677 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703781 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.703989 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704122 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704295 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704377 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704596 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704698 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704891 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.704991 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.705190 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.705278 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.705493 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.705605 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.705794 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.705891 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706087 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706173 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706387 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706473 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706634 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706729 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.706933 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707019 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707210 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707306 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707514 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707609 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707860 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.707947 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708136 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708222 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708385 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708482 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708700 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708795 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.708957 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709056 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709275 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709368 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709590 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709687 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709891 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.709986 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.710191 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.710279 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.710491 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.710580 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.710792 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.710889 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.711086 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.711172 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.711384 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.711470 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.711701 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.711791 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712010 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712106 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712325 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712411 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712630 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712725 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.712943 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713031 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713244 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713329 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713562 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713650 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713859 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.713944 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.714190 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.714276 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.714493 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.714579 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.714792 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.714886 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.715105 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.715201 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.715417 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.715505 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.715742 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.715830 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716044 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716148 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716345 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716479 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716646 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716731 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.716949 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717045 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717255 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717341 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717502 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717595 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717797 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.717893 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.718125 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.718218 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.718419 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.718505 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.718723 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.718810 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719023 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719109 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719324 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719419 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719616 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719724 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.719941 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720040 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720236 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720329 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720534 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720620 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720832 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.720919 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.721130 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.721224 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.721429 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.721560 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.721726 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.721814 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722024 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722118 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722321 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722408 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722619 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722704 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.722922 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723018 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723224 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723520 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723608 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723846 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.723953 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.724146 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.724235 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.724445 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.724540 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.724745 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.724848 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725043 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725137 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725348 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725435 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725644 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725731 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.725944 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726039 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726247 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726333 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726545 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726643 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726843 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.726931 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.727145 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.727240 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.727435 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.727530 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.727758 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.727849 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728053 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728140 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728357 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728453 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728656 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728741 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.728952 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729039 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729252 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729347 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729548 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729644 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729844 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.729932 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.730141 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.730229 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.730436 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.730523 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.730731 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.730818 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731028 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731126 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731323 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731410 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731629 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731763 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.731953 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732050 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732253 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732349 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732555 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732651 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732856 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.732944 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.733170 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:53:43.733257 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.733502 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.734103 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.734353 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.734440 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.734684 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.734779 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.734993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.735092 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.735313 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.735406 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.735623 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.735783 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.735962 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736073 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736271 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736358 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736578 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736663 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736885 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.736973 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.737188 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.737273 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.737495 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.737581 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.737802 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.737890 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.738115 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.738225 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.738422 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.738516 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.738734 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.738830 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739044 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739136 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739348 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739434 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739694 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739787 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.739991 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.740083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.740303 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.740388 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.740627 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.740714 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.740946 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.741048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.741253 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.741355 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.741592 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.741717 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.742162 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.742257 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.742478 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.742618 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.742784 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.742874 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.743095 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.743182 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.743399 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.743494 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.743727 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.743828 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744038 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744350 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744449 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744664 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744759 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.744970 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745056 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745287 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745382 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745595 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745684 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745903 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.745992 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.746207 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.746312 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.746510 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.746597 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.746817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.746906 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.747125 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.747213 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.747432 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.747521 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.747767 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.747858 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748076 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748165 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748382 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748470 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748687 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748783 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.748985 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.749073 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.749809 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.749909 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.750118 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.750205 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.750424 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.750512 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.750721 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.750806 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751024 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751181 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751325 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751414 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751631 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751780 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.751979 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752081 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752280 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752368 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752585 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752722 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752890 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.752986 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.753194 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.753288 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.753492 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.753579 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.753796 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.753959 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.754098 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.754192 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.754399 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.754498 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.754703 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.754798 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755004 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755092 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755301 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755388 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755619 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755757 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.755945 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756039 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756245 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756338 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756552 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756640 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756854 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.756942 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.757158 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.757243 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.757461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.757548 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.757764 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.757851 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758069 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758164 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758375 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758462 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758682 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758769 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.758987 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.759082 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.759296 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.759383 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.759607 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.759722 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.759953 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760261 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760347 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760571 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760656 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760870 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.760967 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.761176 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.761271 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.761472 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.761558 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.761769 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.761895 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762064 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762152 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762363 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762450 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762657 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762779 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.762957 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763095 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763250 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763380 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763545 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763633 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763866 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.763965 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.764165 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.764253 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.764464 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.764553 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.764757 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.764856 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.765102 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.765196 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.765401 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.765489 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.765703 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.765789 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766003 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766099 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766341 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766427 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766639 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766735 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.766967 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.767062 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.767284 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.767371 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.767589 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.767695 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.767926 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768028 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768535 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768623 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768840 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.768927 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.769141 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.769229 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.769448 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.769541 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.769750 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.769843 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770063 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770155 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770363 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770456 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770677 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770765 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.770977 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.771063 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.771289 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.771393 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.771584 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.771693 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.771921 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772010 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772220 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772306 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772531 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772627 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772861 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.772947 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.773181 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.773277 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.773486 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.773575 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.773794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.773880 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.774095 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.774195 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.774397 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.774484 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.774700 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.774794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775001 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775096 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775304 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775398 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775606 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775744 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.775943 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776038 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776246 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776332 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776558 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776648 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776858 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.776958 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.777171 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.777259 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.777471 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.777558 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.777778 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.777867 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.778076 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.778170 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.778387 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.778481 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.778704 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.778793 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779010 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779098 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779321 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779414 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779624 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779773 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.779952 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780040 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780256 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780344 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780584 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780672 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780887 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.780973 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.781187 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.781281 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.781490 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.781577 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.781793 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.781880 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.782098 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.782260 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.782397 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.782486 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.782701 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.782788 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783004 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783107 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783303 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783397 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783603 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783728 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.783935 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784032 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784240 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784328 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784543 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784629 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784860 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.784948 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.785170 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.785257 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.785466 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.785552 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.785766 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.785865 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786082 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786169 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786384 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786476 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786684 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786778 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.786984 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.787075 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.787283 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.787368 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.787586 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.787694 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.787913 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788002 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788235 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788330 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788547 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788635 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788847 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.788933 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.789156 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.789250 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.789465 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.789552 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.789768 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.789855 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790069 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790164 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790380 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790466 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790684 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790771 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.790988 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.791083 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.791295 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.791383 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.791598 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.791732 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.791927 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792023 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792233 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792382 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792528 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792662 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792822 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.792966 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.793119 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.793252 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.793422 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.793555 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.793719 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.793855 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.794022 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.794153 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.794322 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.794454 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.794629 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.794873 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.795022 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.795199 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.795488 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.795631 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.795836 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.795967 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.796669 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.796809 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.796984 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.797128 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.797297 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.797441 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.797612 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.797745 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.797941 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798224 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798362 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798531 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798665 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798832 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.798974 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.799131 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.799272 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.799418 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.799563 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.799761 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.799894 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800029 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800177 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800313 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800445 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800607 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800740 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.800904 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801204 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801345 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801500 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801591 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801799 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.801896 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802098 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802228 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802392 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802482 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802697 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802793 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.802992 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.803078 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.803300 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.803396 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.803600 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.803784 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.803935 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804035 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804234 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804322 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804528 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804622 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804828 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.804918 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.805131 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.805235 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.805466 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.805564 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.805766 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.805854 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.806103 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.806266 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.806406 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.806500 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.806705 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.806792 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807022 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807119 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807322 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807409 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807621 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807738 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.807944 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808051 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808244 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808331 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808544 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808631 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808841 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.808937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.809143 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.809237 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.809443 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.809529 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.809747 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.809835 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810046 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810141 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810343 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810430 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810646 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810740 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.810940 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.811026 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.811242 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.811328 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.811541 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.811629 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.812431 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.812545 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.812740 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.812828 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813079 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813174 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813379 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813469 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813682 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813782 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.813985 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814073 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814280 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814367 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814585 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814679 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814880 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.814975 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.815179 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.815268 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.815598 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.815770 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.815770 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.815970 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816074 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816162 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816366 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816463 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816671 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816758 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.816970 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817060 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817265 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817353 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817560 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817649 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817862 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.817956 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.818159 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.818246 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.818451 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.818538 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.818749 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.818846 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819047 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819142 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819354 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819442 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819649 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819768 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.819975 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820072 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820273 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820361 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820572 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820669 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820871 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.820960 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.821170 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.821257 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.821463 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.821559 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.821764 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.821870 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822059 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822146 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822354 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822454 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822650 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822746 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.822948 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823034 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823249 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823344 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823668 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823872 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.823962 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.824173 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.824270 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.824473 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.824559 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.824775 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.824864 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.825114 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.825203 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.825415 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.825508 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.825724 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.825818 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826036 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826125 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826342 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826437 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826646 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826734 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.826954 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.827042 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.827251 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.827359 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.827598 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.827715 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.827925 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828022 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828229 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828329 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828529 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828630 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828828 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.828917 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.829128 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.829220 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.829430 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.829531 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.829732 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.829818 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830046 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830144 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830355 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830451 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830671 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830758 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.830972 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.831059 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.831273 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.831376 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.831578 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.831690 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.831906 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832033 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832205 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832301 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832507 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832632 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832809 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.832897 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.833110 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.833198 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.833413 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.833542 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.833720 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.833808 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834021 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834116 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834323 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834417 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834626 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834712 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.834925 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835015 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835224 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835312 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835526 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835621 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835853 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.835942 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.836149 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.836235 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.836452 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.836556 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.836749 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.836845 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837051 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837137 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837347 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837443 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837652 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837765 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.837952 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.838071 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.838371 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.838468 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.838667 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.838754 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.838972 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839059 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839271 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839359 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839578 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839682 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839908 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.839996 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.840208 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.840295 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.840517 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.840604 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.840824 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.840911 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.841200 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.841288 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.841506 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.841595 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.841807 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.841894 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.842105 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.842230 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.842402 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.842488 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.842703 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.842799 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843025 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843116 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843324 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843419 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843627 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843778 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.843951 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844038 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844250 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844336 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844563 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844659 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844860 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.844970 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.845179 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.845265 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.845563 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.845659 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.845887 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.845974 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.846189 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.846278 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.846558 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.846659 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.846877 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.846965 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.847183 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.847276 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.847499 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.847586 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.847825 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.847915 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.848135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.848247 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.848440 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.848528 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.848752 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.848842 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849059 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849146 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849362 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849450 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849672 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849761 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.849971 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850068 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850281 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850368 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850583 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850673 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850887 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.850981 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.851204 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.851301 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.851510 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.851598 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.851853 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.851981 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.852233 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.852330 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.852549 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.852638 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.852866 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.852952 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.853166 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.853263 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.853470 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.853558 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.853777 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.853873 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854075 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854172 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854374 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854462 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854672 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854758 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.854977 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.855074 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.855277 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.855365 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.855580 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.855719 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.855909 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856000 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856207 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856296 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856506 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856601 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856806 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.856894 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.857105 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.857191 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.857421 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.857516 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.857721 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.857817 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.858036 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.858131 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.858346 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.858443 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.859164 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.859261 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.859482 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.859571 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.859807 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.859909 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.860106 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.860201 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.860405 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.860501 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.860704 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.860805 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861002 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861095 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861309 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861397 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861629 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861726 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.861937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862027 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862254 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862348 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862555 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862650 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862880 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.862968 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.863184 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.863276 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.863495 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.863589 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.863835 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.863940 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.864148 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.864235 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.864449 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.864537 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.864748 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.864836 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865052 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865152 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865348 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865441 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865644 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865732 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.865943 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.866039 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.866242 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.866337 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.866538 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.866625 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.866834 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.867180 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.867385 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.867473 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.867705 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.867796 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868008 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868108 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868324 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868418 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868624 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868718 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.868921 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869009 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869221 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869308 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869515 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869626 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869816 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.869909 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.870115 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.870202 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.870450 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.870544 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.870749 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.870837 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.871067 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.871155 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.871384 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.871472 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.871711 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.871801 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872035 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872123 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872342 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872436 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872648 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872737 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.872958 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873053 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873266 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873363 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873575 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873671 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873879 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.873967 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.874203 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.874848 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875037 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875125 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875347 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875435 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875701 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875808 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.875993 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.876090 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.876311 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.876502 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.876626 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.876830 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.877140 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.877235 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.877446 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.877540 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.877755 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.877845 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878061 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878156 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878365 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878452 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878671 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878766 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.878973 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.879061 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.879276 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.879365 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.879578 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.879686 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.879908 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880217 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880319 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880542 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880630 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880862 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.880961 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.881171 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.881268 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.881481 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.881570 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.881791 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.881880 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.882100 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.882265 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.882407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.882508 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.882717 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.882806 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883031 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883173 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883340 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883437 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883649 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883789 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.883982 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884070 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884286 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884373 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884591 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884688 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884898 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.884995 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.885202 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.885288 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.885508 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.885603 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.885809 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.885896 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.886113 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.886208 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.886419 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.886520 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.886727 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.886814 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887038 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887127 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887349 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887437 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887675 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887774 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.887986 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.888075 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.888294 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.888384 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.888600 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.888802 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.888911 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.889111 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.889429 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.889526 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.889746 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.889863 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.890118 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.890216 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.890430 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.890519 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.890741 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.890830 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891056 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891152 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891355 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891446 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891672 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891764 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.891986 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892088 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892290 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892426 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892588 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892677 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892891 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.892992 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.893193 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.893289 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.893489 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.893576 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.893803 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.893892 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.894103 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.894190 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.894422 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.894622 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.894726 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.894959 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.895245 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.895333 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.895576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.895712 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.895915 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896004 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896226 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896312 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896527 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896623 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896845 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.896941 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.897145 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.897234 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.897445 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.897542 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.897752 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.897855 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898052 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898139 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898351 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898448 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898649 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898744 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.898949 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899042 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899250 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899349 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899548 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899643 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899876 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.899963 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.900178 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.900268 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.900487 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.900574 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.900789 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.900884 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.901110 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.901198 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.901409 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.901498 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.901710 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.901796 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902007 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902094 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902304 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902415 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902603 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902693 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.902900 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903014 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903204 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903326 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903503 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903603 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903830 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.903919 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.904132 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.904232 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.904433 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.904567 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.904731 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.904828 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.905035 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.905130 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.905334 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.905431 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.905684 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.905774 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906014 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906100 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906313 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906408 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906624 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906720 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.906924 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907015 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907238 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907335 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907543 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907630 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907875 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.907978 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.908187 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.908275 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.908496 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.908585 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.908842 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.909025 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.909161 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.909355 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.909671 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.909764 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.909997 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.910086 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.910315 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.910402 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.910613 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.910700 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.910914 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911010 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911212 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911300 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911532 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911620 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911867 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.911969 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.912174 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.912262 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.912480 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.912568 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.912787 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.912892 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.913087 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.913174 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.913391 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.913480 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.913696 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.913792 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914003 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914092 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914306 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914393 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914606 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914694 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.914909 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915004 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915211 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915297 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915514 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915603 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915843 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.915930 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.916151 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.916241 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.916463 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.916553 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.916783 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.916870 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.917095 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.917193 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.917405 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.917499 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.917709 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.917797 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918014 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918186 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918316 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918406 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918619 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918707 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.918924 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.919018 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.919231 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.919388 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.919702 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.919800 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.920022 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.920121 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.920337 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.920426 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.920643 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.920731 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.921027 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.921618 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.921856 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.921945 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.922163 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.922251 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.922481 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.922576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.922793 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.922889 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.923096 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.923193 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.923416 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.923543 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.923748 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.923842 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.924071 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.924178 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.924380 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.924476 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.924709 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.924797 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925027 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925126 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925330 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925417 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925632 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925719 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.925932 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926022 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926237 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926325 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926537 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926624 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926847 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.926935 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.927147 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.927234 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.927447 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.927534 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.927773 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.927863 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928073 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928163 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928373 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928670 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928802 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.928969 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929056 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929268 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929364 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929565 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929651 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929865 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.929952 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.930164 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.930260 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.930461 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.930554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.930759 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.930846 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931055 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931152 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931355 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931448 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931733 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931824 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.931974 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932108 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932272 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932360 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932569 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932655 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932868 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.932965 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.933166 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.933252 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.933467 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.933556 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.933797 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.933895 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.934118 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.934204 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.934425 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.934513 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.934741 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.934830 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.935045 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.935131 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.935359 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.935445 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.935693 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.935784 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.936002 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.936089 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.936309 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.936409 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.936619 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.936732 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.937473 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.937567 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.937782 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.937878 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.938089 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.938222 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.938397 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.938492 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.938702 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.938800 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939024 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939122 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939327 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939456 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939638 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939758 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.939961 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940056 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940284 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940372 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940593 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940681 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940906 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.940993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.941219 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.941308 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.941526 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.941626 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.941845 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.941938 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.942144 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.942273 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.942450 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.942539 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.942760 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.942847 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.943065 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.943171 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.943368 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.943463 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.943705 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.943797 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944003 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944105 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944320 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944409 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944637 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944724 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.944940 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945036 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945259 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945347 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945564 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945650 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945887 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.945990 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.946203 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.946290 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.946541 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.946629 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.946852 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.946947 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.947165 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.947252 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.947472 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.947561 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.947800 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.947899 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.948042 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:53:43.948131 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.948419 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:53:43.948660 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:53:44.101252 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Registered counter for database nova_api Jun 23 10:53:44.101751 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Registered counter for database nova_api Jun 23 10:53:44.121963 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.123688 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.128668 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.130212 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.185423 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.context [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39972d54-8889-44dd-a663-db2f8dbec8fc(cell1) {{(pid=103170) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 10:53:44.187039 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.context [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39972d54-8889-44dd-a663-db2f8dbec8fc(cell1) {{(pid=103171) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 10:53:44.189382 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.190997 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.191104 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.191771 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.192619 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.193412 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:53:44.193704 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.195342 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:53:44.195674 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Registered counter for database nova_cell0 Jun 23 10:53:44.197317 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Registered counter for database nova_cell0 Jun 23 10:53:44.199743 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Registered counter for database nova_cell1 Jun 23 10:53:44.201271 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Registered counter for database nova_cell1 Jun 23 10:53:44.206888 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.209394 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.212684 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.213214 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.213957 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.221015 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.222766 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.354121 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.363098 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Registered counter for database nova_cell0 Jun 23 10:53:44.371424 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Registered counter for database nova_cell0 Jun 23 10:53:44.371960 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.376278 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.380016 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:53:44.384242 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:53:44.714134 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:53:44.717259 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:53:44.721417 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:53:44.724622 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:53:45.065714 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:53:45.071679 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:53:45.072738 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 10:53:45.076980 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56283b2679c0 pid: 103170 (default app) Jun 23 10:53:45.079216 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-0022cb3b-f605-4379-98d2-92a4b18af2a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 10:53:45.079620 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:53:45.080840 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jun 23 10:53:45.081259 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Thu Jun 23 10:53:45 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:53:45.084530 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56283b2679c0 pid: 103171 (default app) Jun 23 10:54:59.463685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:59.464756 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 23 10:54:59.465141 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:54:59.477768 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:59.478675 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:59.479492 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:59.480513 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:59.909753 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b213394a-aba2-4c53-9402-0e6eebb43e6d admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:54:59.938149 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b213394a-aba2-4c53-9402-0e6eebb43e6d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465617 Jun 23 10:54:59.943331 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Jun 23 10:54:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:02.014322 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:02.015326 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9860cfca-c478-48b2-8eb2-7423cdac0407 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 23 10:55:02.015884 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:02.074439 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3e4fcac3-8721-41ca-aacf-c6ad56e68c33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:02.093144 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:55:02.093144 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jun 23 10:55:02.124082 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3e4fcac3-8721-41ca-aacf-c6ad56e68c33 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101974 Jun 23 10:55:02.128022 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:02.138806 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:02.140005 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:02.141261 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:02.143090 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:02.353478 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-54397916-f651-42de-8021-4b65fc538be7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:02.355919 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:55:02.355919 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 23 10:55:02.421810 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-54397916-f651-42de-8021-4b65fc538be7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288014 Jun 23 10:55:02.422540 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Jun 23 10:55:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:04.495288 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3e4fcac3-8721-41ca-aacf-c6ad56e68c33 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:04.497472 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3e4fcac3-8721-41ca-aacf-c6ad56e68c33 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jun 23 10:55:04.498031 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:04.615209 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5aba5235-e455-45f2-b784-97d8f1c671f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:04.633788 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:55:04.633788 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 23 10:55:04.651649 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5aba5235-e455-45f2-b784-97d8f1c671f4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146927 Jun 23 10:55:04.652244 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:04.663934 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-20e60571-0ed1-40e3-9e8f-71f7c209b3e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:04.665434 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:55:04.665434 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jun 23 10:55:04.696696 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-20e60571-0ed1-40e3-9e8f-71f7c209b3e5 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036311 Jun 23 10:55:04.697418 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Jun 23 10:55:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:06.752005 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5aba5235-e455-45f2-b784-97d8f1c671f4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:06.753131 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5aba5235-e455-45f2-b784-97d8f1c671f4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jun 23 10:55:06.753572 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:06.812581 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-cc477eb8-d4e9-4f55-bacb-2c15d0bca49b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:06.834610 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-cc477eb8-d4e9-4f55-bacb-2c15d0bca49b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075038 Jun 23 10:55:06.842788 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:06.848924 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e39205f5-cf97-48fb-8623-e694d0e532ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:06.875164 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-e39205f5-cf97-48fb-8623-e694d0e532ea admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030522 Jun 23 10:55:06.875928 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Jun 23 10:55:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:08.937818 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-cc477eb8-d4e9-4f55-bacb-2c15d0bca49b admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:08.938841 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-cc477eb8-d4e9-4f55-bacb-2c15d0bca49b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 23 10:55:08.940037 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:09.003324 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-380b22af-e682-4775-87f1-d4e6aff9e041 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "ram": 2048, "disk": 10, "vcpus": 2}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:09.020993 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-380b22af-e682-4775-87f1-d4e6aff9e041 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075429 Jun 23 10:55:09.021784 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:09.033252 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-6a08ced4-cae0-4b08-9012-dc3bc9e851dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:09.055079 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-6a08ced4-cae0-4b08-9012-dc3bc9e851dc admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025503 Jun 23 10:55:09.055622 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Jun 23 10:55:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:11.177786 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-380b22af-e682-4775-87f1-d4e6aff9e041 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:11.178730 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-380b22af-e682-4775-87f1-d4e6aff9e041 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 23 10:55:11.179139 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:11.237626 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-44864d78-911c-400c-9ef8-fec77b317bb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:11.254751 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-44864d78-911c-400c-9ef8-fec77b317bb1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069842 Jun 23 10:55:11.255285 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:11.267084 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6895b80e-7a69-4e55-9b32-81b978dd464e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:11.289383 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6895b80e-7a69-4e55-9b32-81b978dd464e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025954 Jun 23 10:55:11.290102 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Thu Jun 23 10:55:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:55:13.346489 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-44864d78-911c-400c-9ef8-fec77b317bb1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:13.347559 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-44864d78-911c-400c-9ef8-fec77b317bb1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 23 10:55:13.347943 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:13.407170 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-a06cd38f-0f3c-4ad4-96e1-5f2151213a12 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:13.430105 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-a06cd38f-0f3c-4ad4-96e1-5f2151213a12 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076049 Jun 23 10:55:13.430881 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Jun 23 10:55:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:15.518159 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-44864d78-911c-400c-9ef8-fec77b317bb1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:15.519222 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-44864d78-911c-400c-9ef8-fec77b317bb1 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 23 10:55:15.529638 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:15.590330 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-af1defab-44c2-4414-8fed-b7c1c7b35388 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "disk": 1}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:15.609758 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-af1defab-44c2-4414-8fed-b7c1c7b35388 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084377 Jun 23 10:55:15.610216 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:55:15.623938 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-f8f33203-d8a3-4da2-ba25-f6614df465c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:15.648930 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-f8f33203-d8a3-4da2-ba25-f6614df465c6 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028898 Jun 23 10:55:15.649793 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Jun 23 10:55:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:55:18.137830 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-af1defab-44c2-4414-8fed-b7c1c7b35388 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:18.139129 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-af1defab-44c2-4414-8fed-b7c1c7b35388 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Jun 23 10:55:18.139710 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:18.201081 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-4e02615d-f849-4115-841c-6b61ac6ce159 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:18.221134 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-4e02615d-f849-4115-841c-6b61ac6ce159 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074268 Jun 23 10:55:18.221737 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:18.233576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6d026586-c464-430c-8e09-9523107f1b0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:18.255812 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6d026586-c464-430c-8e09-9523107f1b0b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025850 Jun 23 10:55:18.256385 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Jun 23 10:55:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:20.348296 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-4e02615d-f849-4115-841c-6b61ac6ce159 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:20.349164 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-4e02615d-f849-4115-841c-6b61ac6ce159 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 23 10:55:20.349561 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:20.424961 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-4dcd6f2d-f108-4f29-ac27-252a938162d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:20.442443 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-4dcd6f2d-f108-4f29-ac27-252a938162d9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.087040 Jun 23 10:55:20.443030 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:55:20.454787 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-934f1139-3c56-4b3b-a209-e133981f29b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:20.478964 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-934f1139-3c56-4b3b-a209-e133981f29b4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027781 Jun 23 10:55:20.479541 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Jun 23 10:55:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:22.546828 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-4dcd6f2d-f108-4f29-ac27-252a938162d9 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:22.547885 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-4dcd6f2d-f108-4f29-ac27-252a938162d9 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 23 10:55:22.548281 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:22.605406 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-59b1abbc-b2cb-4681-afae-786cd025f347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:22.622867 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-59b1abbc-b2cb-4681-afae-786cd025f347 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069045 Jun 23 10:55:22.623677 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:55:22.636173 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-1ed1e446-6129-4ae8-ba01-4985a24f733e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:22.658067 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-1ed1e446-6129-4ae8-ba01-4985a24f733e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025693 Jun 23 10:55:22.658907 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Jun 23 10:55:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:55:24.724516 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-59b1abbc-b2cb-4681-afae-786cd025f347 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:24.725539 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-59b1abbc-b2cb-4681-afae-786cd025f347 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 23 10:55:24.725937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:24.799978 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-c14dfd66-7631-48c3-a1cb-aed5b26ffa56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "id": "5", "disk": 160, "ram": 16384}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:24.818173 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-c14dfd66-7631-48c3-a1cb-aed5b26ffa56 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.086087 Jun 23 10:55:24.818950 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Thu Jun 23 10:55:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:24.831189 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-bc46da51-8193-47e4-846f-de5110b0e6e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:24.854940 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-bc46da51-8193-47e4-846f-de5110b0e6e7 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027529 Jun 23 10:55:24.856201 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Thu Jun 23 10:55:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:55:49.379273 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-c14dfd66-7631-48c3-a1cb-aed5b26ffa56 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:49.380455 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-c14dfd66-7631-48c3-a1cb-aed5b26ffa56 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Jun 23 10:55:49.380854 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:49.391633 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:49.440157 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ea9a4683-4ee8-425b-bb3e-a4aa23a20b09 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:49.456622 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ea9a4683-4ee8-425b-bb3e-a4aa23a20b09 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069587 Jun 23 10:55:49.457136 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Jun 23 10:55:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:50.364927 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-c14dfd66-7631-48c3-a1cb-aed5b26ffa56 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:50.365930 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-c14dfd66-7631-48c3-a1cb-aed5b26ffa56 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 23 10:55:50.366328 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:50.553592 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ac59a0ba-8945-4a2a-b000-50e762c3827a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:50.559179 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-ac59a0ba-8945-4a2a-b000-50e762c3827a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ac59a0ba-8945-4a2a-b000-50e762c3827a admin admin] Request method failure captured: Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Accept: application/json Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Connection: keep-alive Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Content-Length: 0 Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Host: 10.222.0.65 Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABitEa2obHuwyE5cRMvYfx0BDdJov5KsHey0-gmHMCv_R6Ob8ZYMdMORf8GWohgIhvV37QkQiwKUP5lqOtnKJLLSiP8_3Kti_-LzUrd6cYHY1-DfF8mgqw-CtrPcBClyyCr9FQkWLO0lzO8rZzrVa2qPjd07ms4NMLwhLlgPHejCvGjxNY Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Role: admin,member,reader Jun 23 10:55:50.562461 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Roles: admin,member,reader Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_06f70799381a401b8e11df5b00b4192c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant: admin Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User: admin Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Id: 7c47db9f01c84c63b57cf3ae5711ffb1 Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Name: admin Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: method: > Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: exception: Flavor 42 could not be found. Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: action_args: {'id': '42'} Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:50.564181 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:50.565407 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.566817 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ac59a0ba-8945-4a2a-b000-50e762c3827a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:50.568137 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ac59a0ba-8945-4a2a-b000-50e762c3827a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060913 Jun 23 10:55:50.568137 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Jun 23 10:55:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:50.573378 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-c5eb7f42-797f-48c9-81b3-0167631c3b52 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:50.576336 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:50.595729 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-c5eb7f42-797f-48c9-81b3-0167631c3b52 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025870 Jun 23 10:55:50.596253 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Jun 23 10:55:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:50.606302 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-9e952f03-1c70-4097-8158-de72ab262ed0 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:50.628478 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-9e952f03-1c70-4097-8158-de72ab262ed0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025818 Jun 23 10:55:50.629010 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Jun 23 10:55:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:50.638791 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-55447ddc-8a31-4dee-bb80-4509e88707aa admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:50.645448 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-55447ddc-8a31-4dee-bb80-4509e88707aa admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-55447ddc-8a31-4dee-bb80-4509e88707aa admin admin] Request method failure captured: Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Accept: application/json Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Connection: keep-alive Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Content-Length: 0 Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Host: 10.222.0.65 Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABitEa2obHuwyE5cRMvYfx0BDdJov5KsHey0-gmHMCv_R6Ob8ZYMdMORf8GWohgIhvV37QkQiwKUP5lqOtnKJLLSiP8_3Kti_-LzUrd6cYHY1-DfF8mgqw-CtrPcBClyyCr9FQkWLO0lzO8rZzrVa2qPjd07ms4NMLwhLlgPHejCvGjxNY Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Role: admin,member,reader Jun 23 10:55:50.648685 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Roles: admin,member,reader Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_06f70799381a401b8e11df5b00b4192c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant: admin Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User: admin Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Id: 7c47db9f01c84c63b57cf3ae5711ffb1 Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Name: admin Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: method: > Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: exception: Flavor 42 could not be found. Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: action_args: {'id': '42'} Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:50.650230 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:50.651135 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:50.652210 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-55447ddc-8a31-4dee-bb80-4509e88707aa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:50.653222 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-55447ddc-8a31-4dee-bb80-4509e88707aa admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015429 Jun 23 10:55:50.653222 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Jun 23 10:55:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:51.454033 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-9e952f03-1c70-4097-8158-de72ab262ed0 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:51.455047 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-9e952f03-1c70-4097-8158-de72ab262ed0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 23 10:55:51.455447 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:51.646314 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-66f88c73-c6b6-41e2-8780-126c03bd9af2 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:51.653632 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-66f88c73-c6b6-41e2-8780-126c03bd9af2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-66f88c73-c6b6-41e2-8780-126c03bd9af2 admin admin] Request method failure captured: Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Accept: application/json Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Connection: keep-alive Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Content-Length: 0 Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Host: 10.222.0.65 Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABitEa3t2egbcNIaBcyXuvHp7ev39Tp43q-XR3Kc7L3j949EtnSTMfLLRWeBwxActfJCsNTOESwvGVZPTK-wev1-plYf9sSbT6bTBWfNtaTzBu7FjvbBPc6Sd4xyzw3jpzqMfjt36ScXKnLRR72-G7bOyvyquMArCLKn8PkaHcObmehHEg Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Role: admin,member,reader Jun 23 10:55:51.655112 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Roles: admin,member,reader Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_06f70799381a401b8e11df5b00b4192c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant: admin Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User: admin Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Id: 7c47db9f01c84c63b57cf3ae5711ffb1 Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Name: admin Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: method: > Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: exception: Flavor 84 could not be found. Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: action_args: {'id': '84'} Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:51.656795 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:51.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.659083 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-66f88c73-c6b6-41e2-8780-126c03bd9af2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:51.660367 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-66f88c73-c6b6-41e2-8780-126c03bd9af2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062745 Jun 23 10:55:51.660367 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Jun 23 10:55:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:51.666190 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d8562006-5634-4484-a336-2f212337098e admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:51.679521 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-d8562006-5634-4484-a336-2f212337098e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016970 Jun 23 10:55:51.680069 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Jun 23 10:55:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:51.689078 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-7e078bd7-2ba2-48bb-828e-5dbeaffd168b admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:51.702868 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-7e078bd7-2ba2-48bb-828e-5dbeaffd168b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017174 Jun 23 10:55:51.703372 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Jun 23 10:55:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:51.712844 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-1eff595e-7e83-45d0-9e9d-85ed81000ab9 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:51.718019 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-1eff595e-7e83-45d0-9e9d-85ed81000ab9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-1eff595e-7e83-45d0-9e9d-85ed81000ab9 admin admin] Request method failure captured: Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Accept: application/json Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Connection: keep-alive Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Content-Length: 0 Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Host: 10.222.0.65 Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABitEa3t2egbcNIaBcyXuvHp7ev39Tp43q-XR3Kc7L3j949EtnSTMfLLRWeBwxActfJCsNTOESwvGVZPTK-wev1-plYf9sSbT6bTBWfNtaTzBu7FjvbBPc6Sd4xyzw3jpzqMfjt36ScXKnLRR72-G7bOyvyquMArCLKn8PkaHcObmehHEg Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Role: admin,member,reader Jun 23 10:55:51.719506 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Roles: admin,member,reader Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_06f70799381a401b8e11df5b00b4192c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant: admin Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User: admin Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Id: 7c47db9f01c84c63b57cf3ae5711ffb1 Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Name: admin Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: method: > Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: exception: Flavor 84 could not be found. Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: action_args: {'id': '84'} Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:51.721049 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:51.722554 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:51.723926 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-1eff595e-7e83-45d0-9e9d-85ed81000ab9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:51.725162 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-1eff595e-7e83-45d0-9e9d-85ed81000ab9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011503 Jun 23 10:55:51.725162 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Thu Jun 23 10:55:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 10:55:52.538877 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-7e078bd7-2ba2-48bb-828e-5dbeaffd168b admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:52.539897 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-7e078bd7-2ba2-48bb-828e-5dbeaffd168b admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 23 10:55:52.540309 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:52.728793 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-49e6a82f-d139-4eb4-ae89-d7344cfebf90 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:52.734485 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-49e6a82f-d139-4eb4-ae89-d7344cfebf90 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-49e6a82f-d139-4eb4-ae89-d7344cfebf90 admin admin] Request method failure captured: Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Accept: application/json Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Connection: keep-alive Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Content-Length: 0 Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Host: 10.222.0.65 Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABitEa4fkIEutvgpGbdW2JeEj2P0FtOCdEjVJqbiURIcPGLH1pEIZPqP5TvIQp6XOIHe43kGDjqlcs4KKykoxfrJu0C3ZkGo_VPhoLQYTL9TLG1nqhBAUQxqCvjlb4S7NVE4GcuQfgMdSTjkbYMJB-o0__wA9afFElIsNvrdY0B9Fe6YWQ Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Role: admin,member,reader Jun 23 10:55:52.735993 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Roles: admin,member,reader Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_06f70799381a401b8e11df5b00b4192c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant: admin Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User: admin Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Id: 7c47db9f01c84c63b57cf3ae5711ffb1 Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: X-User-Name: admin Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: method: > Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: exception: Flavor 451 could not be found. Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: action_args: {'id': '451'} Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:52.738027 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:52.738937 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.740319 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-49e6a82f-d139-4eb4-ae89-d7344cfebf90 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:52.741541 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-49e6a82f-d139-4eb4-ae89-d7344cfebf90 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059281 Jun 23 10:55:52.741541 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Jun 23 10:55:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:52.747351 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d4339091-6177-4071-8066-e416e911b9c3 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:52.762090 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-d4339091-6177-4071-8066-e416e911b9c3 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018328 Jun 23 10:55:52.762608 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Jun 23 10:55:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:52.772042 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:52.785333 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016825 Jun 23 10:55:52.785835 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Thu Jun 23 10:55:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:55:52.794768 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-118c8c01-f7e1-415e-b292-8d4909ba2556 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:52.800507 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-118c8c01-f7e1-415e-b292-8d4909ba2556 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-118c8c01-f7e1-415e-b292-8d4909ba2556 admin admin] Request method failure captured: Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Accept: application/json Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Connection: keep-alive Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Content-Length: 0 Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Host: 10.222.0.65 Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABitEa4fkIEutvgpGbdW2JeEj2P0FtOCdEjVJqbiURIcPGLH1pEIZPqP5TvIQp6XOIHe43kGDjqlcs4KKykoxfrJu0C3ZkGo_VPhoLQYTL9TLG1nqhBAUQxqCvjlb4S7NVE4GcuQfgMdSTjkbYMJB-o0__wA9afFElIsNvrdY0B9Fe6YWQ Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Domain-Id: None Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Domain-Name: None Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Project-Name: admin Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Role: admin,member,reader Jun 23 10:55:52.802048 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Roles: admin,member,reader Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_06f70799381a401b8e11df5b00b4192c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/06f70799381a401b8e11df5b00b4192c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant: admin Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant-Id: 06f70799381a401b8e11df5b00b4192c Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User: admin Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Id: 7c47db9f01c84c63b57cf3ae5711ffb1 Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: X-User-Name: admin Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: method: > Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: exception: Flavor 451 could not be found. Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: action_args: {'id': '451'} Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 10:55:52.803550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:52.804530 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Jun 23 10:55:52.805576 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-118c8c01-f7e1-415e-b292-8d4909ba2556 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 10:55:52.806586 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-118c8c01-f7e1-415e-b292-8d4909ba2556 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012509 Jun 23 10:55:52.806586 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Jun 23 10:55:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:53.613391 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:53.614396 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 23 10:55:53.614831 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:53.809988 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ba7ce099-8731-435e-b1ea-4f8585d8f19f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:53.827967 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ba7ce099-8731-435e-b1ea-4f8585d8f19f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076655 Jun 23 10:55:53.828435 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Jun 23 10:55:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:54.643208 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:54.644844 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jun 23 10:55:54.645250 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:54.830991 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-b0ddf00d-35d2-49f2-8338-d6e2caece523 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:54.848174 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-b0ddf00d-35d2-49f2-8338-d6e2caece523 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068595 Jun 23 10:55:54.848698 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Jun 23 10:55:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:55.665112 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:55.666171 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 23 10:55:55.666556 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 10:55:55.851874 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9e9ecff7-1091-4e44-bdac-258dfdfd6c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:55.869572 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9e9ecff7-1091-4e44-bdac-258dfdfd6c2e admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068312 Jun 23 10:55:55.870109 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Jun 23 10:55:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:55:56.683341 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:56.684390 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 23 10:55:56.684781 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:56.871490 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-03280238-9365-4a58-95da-611caad53b20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 10:55:56.889383 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-03280238-9365-4a58-95da-611caad53b20 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068426 Jun 23 10:55:56.889910 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Thu Jun 23 10:55:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 10:55:57.700946 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:57.701949 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 23 10:55:57.702333 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:55:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:55:57.889732 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ebafd2b7-a9b5-43d8-863a-2ae3862aa151 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:55:57.910550 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ebafd2b7-a9b5-43d8-863a-2ae3862aa151 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071934 Jun 23 10:55:57.911116 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Thu Jun 23 10:55:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:43.959478 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:43.960535 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-42f483f2-9caa-417b-b336-8d5225632065 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 23 10:56:43.960929 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Thu Jun 23 10:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:56:43.971034 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:44.019405 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-259ab94b-4095-44aa-b414-eb4a46b96841 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.045320 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-259ab94b-4095-44aa-b414-eb4a46b96841 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078732 Jun 23 10:56:44.045928 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Thu Jun 23 10:56:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 10:56:44.068701 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-5d149490-4de5-4a20-a536-bf544b11cfdd admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.072128 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=14 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:44.078229 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-5d149490-4de5-4a20-a536-bf544b11cfdd admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013129 Jun 23 10:56:44.078757 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Thu Jun 23 10:56:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:44.089706 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-40db509c-a47c-4ef5-be18-fe8edd4ca8ed admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.097452 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-40db509c-a47c-4ef5-be18-fe8edd4ca8ed admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011263 Jun 23 10:56:44.097984 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Thu Jun 23 10:56:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:44.109368 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.116972 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011171 Jun 23 10:56:44.117475 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Thu Jun 23 10:56:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 10:56:44.128945 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-c4f461ff-7ec8-444c-ba1e-7d4e391feb34 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:56:44.136312 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-c4f461ff-7ec8-444c-ba1e-7d4e391feb34 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010870 Jun 23 10:56:44.136812 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Thu Jun 23 10:56:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 10:59:57.817248 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:57.818297 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 23 10:59:57.818694 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:59:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:59:57.961880 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=6 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:58.073714 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-30bb3975-c062-4889-8af5-e01a9b810dec admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:58.074891 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:59:58.074891 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 23 10:59:58.076165 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-30bb3975-c062-4889-8af5-e01a9b810dec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:58.076611 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-30bb3975-c062-4889-8af5-e01a9b810dec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:58.077410 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-30bb3975-c062-4889-8af5-e01a9b810dec admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:58.077844 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-30bb3975-c062-4889-8af5-e01a9b810dec admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:58.112202 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-30bb3975-c062-4889-8af5-e01a9b810dec admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152189 Jun 23 10:59:58.112765 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Jun 23 10:59:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 10:59:58.940564 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:58.941620 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 23 10:59:58.942030 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 10:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 10:59:59.136124 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-93c71f3f-fe73-4f5d-821b-e3d5f7df3ca1 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 10:59:59.137345 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:59:59.137345 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 23 10:59:59.138540 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93c71f3f-fe73-4f5d-821b-e3d5f7df3ca1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:59.138999 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93c71f3f-fe73-4f5d-821b-e3d5f7df3ca1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:59.139836 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93c71f3f-fe73-4f5d-821b-e3d5f7df3ca1 admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 10:59:59.140272 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-93c71f3f-fe73-4f5d-821b-e3d5f7df3ca1 admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 10:59:59.159496 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-93c71f3f-fe73-4f5d-821b-e3d5f7df3ca1 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077485 Jun 23 10:59:59.160019 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Jun 23 10:59:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:00:10.410247 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:10.411246 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 23 11:00:10.411634 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 11:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:10.555089 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:10.555852 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:10.556516 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=8 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:10.604444 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-1d1ebe64-7fac-4560-bc7d-a2a6b6b19873 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:10.605625 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:00:10.605625 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 23 11:00:10.606810 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-1d1ebe64-7fac-4560-bc7d-a2a6b6b19873 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:10.607254 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-1d1ebe64-7fac-4560-bc7d-a2a6b6b19873 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:10.608108 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-1d1ebe64-7fac-4560-bc7d-a2a6b6b19873 admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:10.608539 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-1d1ebe64-7fac-4560-bc7d-a2a6b6b19873 admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:10.634940 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-1d1ebe64-7fac-4560-bc7d-a2a6b6b19873 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084718 Jun 23 11:00:10.635432 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Jun 23 11:00:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:00:11.453630 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:11.454697 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0e26134d-8131-4ee2-b775-6bfaa394b2dc admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 23 11:00:11.455086 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Thu Jun 23 11:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:00:11.643258 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-39c1e871-329f-41c3-9fe1-af6f2cef4bae admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:00:11.644464 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:00:11.644464 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: warnings.warn(msg) Jun 23 11:00:11.645673 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-39c1e871-329f-41c3-9fe1-af6f2cef4bae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:11.646146 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-39c1e871-329f-41c3-9fe1-af6f2cef4bae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:11.647583 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-39c1e871-329f-41c3-9fe1-af6f2cef4bae admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:00:11.648046 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-39c1e871-329f-41c3-9fe1-af6f2cef4bae admin admin] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:00:11.669351 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-39c1e871-329f-41c3-9fe1-af6f2cef4bae admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076842 Jun 23 11:00:11.669830 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Thu Jun 23 11:00:11 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:01:07.623043 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: Thu Jun 23 11:01:07 2022 - graceful shutdown triggered... Jun 23 11:01:07.623189 dv-cinder-843309-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 11:01:07.624116 dv-cinder-843309-2-iscsi devstack@n-api.service[103170]: Gracefully killing worker 1 (pid: 103170)... Jun 23 11:01:07.624585 dv-cinder-843309-2-iscsi devstack@n-api.service[103171]: Gracefully killing worker 2 (pid: 103171)... Jun 23 11:01:08.625096 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: worker 1 buried after 1 seconds Jun 23 11:01:08.625620 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: worker 2 buried after 1 seconds Jun 23 11:01:08.625620 dv-cinder-843309-2-iscsi devstack@n-api.service[103169]: goodbye to uWSGI. Jun 23 11:01:08.626741 dv-cinder-843309-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 11:01:08.627295 dv-cinder-843309-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 11:01:08.630100 dv-cinder-843309-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 11:01:08.643015 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:01:08 2022] *** Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: nodename: dv-cinder-843309-2-iscsi Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: machine: x86_64 Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: clock source: unix Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: pcre jit disabled Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: detected number of CPU cores: 4 Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: current working directory: / Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:01:08.645778 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: your processes number limit is 47680 Jun 23 11:01:08.646721 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: your memory page size is 4096 bytes Jun 23 11:01:08.646721 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: detected max file descriptor number: 2048 Jun 23 11:01:08.646721 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: lock engine: pthread robust mutexes Jun 23 11:01:08.646721 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: thunder lock: enabled Jun 23 11:01:08.646721 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 11:01:08.646721 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:01:08.692893 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: Python main interpreter initialized at 0x55618b8179c0 Jun 23 11:01:08.692893 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: python threads support enabled Jun 23 11:01:08.692893 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: your server socket listen backlog is limited to 100 connections Jun 23 11:01:08.692893 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:01:08.693347 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:01:08.693347 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: *** Operational MODE: preforking *** Jun 23 11:01:08.693665 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:01:08.693665 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: spawned uWSGI master process (pid: 117857) Jun 23 11:01:08.693878 dv-cinder-843309-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 11:01:08.694672 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: spawned uWSGI worker 1 (pid: 117877, cores: 1) Jun 23 11:01:08.695678 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: spawned uWSGI worker 2 (pid: 117878, cores: 1) Jun 23 11:01:08.695977 dv-cinder-843309-2-iscsi devstack@n-api.service[117857]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:01:09.357957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:01:09.370098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:01:10.560090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:01:10.560090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: from cryptography.utils import int_from_bytes Jun 23 11:01:10.560723 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:01:10.560723 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: from cryptography.utils import int_from_bytes Jun 23 11:01:10.580378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:01:10.580378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: from cryptography.utils import int_from_bytes Jun 23 11:01:10.580922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:01:10.580922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: from cryptography.utils import int_from_bytes Jun 23 11:01:12.956370 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:01:12.956982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:01:12.957272 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:01:12.957545 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:01:12.957809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:01:12.958216 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.958540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.958866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.959189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.959526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.959863 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.960191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.960515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.960847 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.961655 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.961973 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.962300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-2-iscsi {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.962626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.962940 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.963255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.963582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.963915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.964242 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.964551 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.965064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.966789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.966789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.966789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.966789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.966789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.967212 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.967470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.967718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.968052 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.968356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.968770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-2-iscsi {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.969101 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.969408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.969724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.970163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.970493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.970790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.971106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.971434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.971771 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.972102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.972420 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.972748 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.973059 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.973366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.973675 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.973993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.974315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.974624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.974928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.975180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.975489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.975841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.976166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.976491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.977323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.977576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.977899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.978222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.978533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.978845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.979148 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.979459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.979789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.980108 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.980416 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.980721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.981046 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.981367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.981690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.982001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.982321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.982732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.982985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.983300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.983644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.983990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.984298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.984619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.984945 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.985253 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.985566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.985874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.986195 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.986538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.986844 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.987099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.987401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.987737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.988054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.988363 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.988671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.988980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.989282 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.989591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.989898 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.990211 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.990517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.990823 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.991129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.991436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.991764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.992075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.992434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.992758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.993065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.993373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.993680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.993989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.994758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.995078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.995392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.995745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.996063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.996375 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.996697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.997009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.997320 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.997640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.997943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.998251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.998570 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.998873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.999181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.999488 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.999819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:12.999987 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:01:13.000470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.000647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:01:13.000802 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.000955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:01:13.001113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.001113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.001396 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:01:13.001563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.001708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:01:13.001859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002028 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002358 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002522 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.002977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.003128 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.003282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.003426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.003575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.003780 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.003938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.004122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.004274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.004429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.004600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.004600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.004895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.005055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.005209 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.005354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-2-iscsi {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.005514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.005669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.005818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.005972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.006114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.006256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.006412 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.006565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.006707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.006858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.007000 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.007149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.007304 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.007448 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.007590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.007590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.008570 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.008764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.008917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.009060 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.009202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.009357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.009524 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.009684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.009847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.009994 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.010282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.010449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.010605 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.010760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.010906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.011058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.011202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.011344 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.011503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.011687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.011854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.011999 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.012142 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-2-iscsi {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.012298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.012460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.012612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.012763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.012906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.013049 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.013199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.013351 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.013503 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.013646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.013788 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.013941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.014093 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.014235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.014407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.014559 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.014702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.014857 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.015010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.015160 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.015310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.015459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.015611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.015798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.015953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.016096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.016257 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.016401 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.016542 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.016692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.016843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.016988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.017140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.017292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.017292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.017581 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.017724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.017872 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.018017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.018710 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.018874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.019031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.019183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.019333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.019486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.019630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.019850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.020017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.020886 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.021052 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.021210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.021385 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.021646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.021812 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.021957 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.022109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.022262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.022414 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.022566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.022566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.022836 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.022990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.023140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.024104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.024237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.024322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.024404 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.024486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.024560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.024643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.024717 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.024803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.024877 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.024949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.025033 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025107 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.025178 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.025338 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025418 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.025506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.025721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025794 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.025864 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.025949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.026022 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.026093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.026170 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.026250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.026322 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.026404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.026484 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.026566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.026640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.026711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.026856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.026940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.027012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.027088 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.027160 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.027237 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.027322 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.027817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.027930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.027930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.028071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.028212 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.028454 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.028622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.028817 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.028956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.029124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.029294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.029432 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.029728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.029873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.030065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.030204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.030370 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.030608 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.030763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.030982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.031171 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.031310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.031580 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.031738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.031935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.032100 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.032237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.032530 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.032687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.032829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.033000 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.033138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.033405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.033550 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.033726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.033875 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.034039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.034303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.034437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.034633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.034765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.034937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.035173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.035313 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.035570 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.035721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.035937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.036087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.036279 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.036497 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.036639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.036908 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.037050 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.037224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.037394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.037527 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.037816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.037957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.038137 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.038276 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.038451 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.038710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.038866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.039132 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.039960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.040122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.040299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.040440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.040612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.040849 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.041004 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.041243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.041396 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.041576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.041795 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.041947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.042170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.042313 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.042624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.042784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.042922 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.043073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.043266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.043448 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.043592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.043797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.043938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.044116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.044381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.044513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.044729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.044858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.045040 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.045266 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.045399 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.045656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.045800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.045967 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.046144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.046275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.046616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.046938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.047081 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.047247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.047499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.047630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.047881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.048022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.048197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.048405 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.048540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.048831 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.048965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.049140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.049350 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.049483 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.049717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.049851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.050121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.050277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.050415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.050671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.050809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.051026 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.051159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.051327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.052311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.052464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.052464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.052872 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053006 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:01:13.053146 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053146 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053469 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.053887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054500 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054660 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054660 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.054917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.055056 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.055215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.055357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.055546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.055715 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.055879 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.056144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.056285 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.056497 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.056642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.056810 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.057046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.057180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.057411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.057618 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.057751 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.057952 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.058095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.058395 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.058538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.058740 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.058929 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.059072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.059393 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.059537 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.059706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.059854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.060031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.060296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.060430 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.060655 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.060796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.060992 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.061201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.061334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.061578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.061719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.061896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.062062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.062219 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.062506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.062648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.062801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.063091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.063227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.063408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.063615 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.063795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.063936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.064082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.064336 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.064475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.064649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.064840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.064983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.065283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.065537 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.065733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.065865 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.066161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.066310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.066482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.066642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.066803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.067068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.067201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.067441 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.067573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.067877 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.068067 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.068208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.068426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.068574 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.068742 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.068912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.069055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.069344 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.069497 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.069690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.069832 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.069963 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.070846 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.070995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.071134 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.071342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.071476 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.071664 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.071815 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.071986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.072182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.072315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.072617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.072761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.072905 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.073208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.073346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.073483 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.073635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.073838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.073972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.074102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.074368 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.074510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.074670 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.074841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.074990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.075266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.075405 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.075611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.075779 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.076477 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.076615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.076762 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.076894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.077030 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.077030 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.077289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.077419 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.077556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.077693 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.078146 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.078292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.078423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.078553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.078692 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.078692 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.079007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.079153 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.079283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.079493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.079637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.079909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.080054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.080220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.080426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.080568 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.080840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.081189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.081341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.081561 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.081709 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.081840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.082039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.082172 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.082350 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.082764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.082919 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.083050 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.083191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.083421 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.083641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.083814 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084296 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084554 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.084884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.085038 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.085263 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.085397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.085633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.085778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.086546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.086695 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.086867 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.087109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.087252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.087488 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.087621 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.087816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.088032 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.095049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.095230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.095520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.095744 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.095898 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096438 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.096967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.097307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.097307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.097760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.097890 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098157 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098821 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.098963 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099365 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.099920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.100133 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.100738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.100839 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.100934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101206 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101795 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.101983 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102068 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102068 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102568 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102651 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102740 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.102924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103333 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103713 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.103910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.104089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.104428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.104521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.104623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.104623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105006 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105273 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105797 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.105896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106136 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106661 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106661 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.106914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107083 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107765 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.107861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.108017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.108160 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.108452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.108602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.108909 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.109012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.109220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.109402 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.109527 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.109831 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.109934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.110141 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.110329 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.110460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.110757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.110850 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.111076 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.111230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.111496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.111696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.111836 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.112095 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.112202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.112448 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.112540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.112754 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.112977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.113072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.113358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.113451 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.113682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.113855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.113987 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.114286 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.114533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.114631 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.114757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.114899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.115207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.115323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.115526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.115768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.115966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.116149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.116292 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.116540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.116644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.116859 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.117002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.117286 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.117388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.117626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.117723 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.117939 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.118985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.119446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.119557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.119790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.119900 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.120096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.120191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.120399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.120514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.120709 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.120918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.121247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.121556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.121884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.122210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.122314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.122528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.122632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.122856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.122961 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.123183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.123277 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.123507 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.123604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.123860 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124164 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124350 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124795 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.124993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.125150 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.125316 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.125592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.125777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.125926 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.126130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.126280 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.126433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.126578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.126730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.126936 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.127088 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.127220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.127435 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.127628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.127756 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.127972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128068 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128591 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128692 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.128991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.129241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.129338 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.129556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.129660 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.129861 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.129964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.130180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.130274 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.130489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.130595 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.130803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.130895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.131120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.131212 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.131427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.131533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.131757 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.131855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.132065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.132169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.132411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.132517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.132719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.133324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.133559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.133653 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.133889 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.133989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.134201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.134294 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.134511 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.134613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.134837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.134939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.135157 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.135285 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.135470 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.135587 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.135877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.135987 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.136105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.136207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.136415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.136517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.136719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.136811 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.137032 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.137299 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.137401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.137633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.137733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.137940 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138032 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138350 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138664 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.138962 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.139175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.139267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.139502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.139596 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.139833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.139929 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.140161 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.140267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.140474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.140568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.140776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.140880 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.141080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.141182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.141388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.141480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.141688 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.141793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.142064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.142327 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.142420 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.142635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.142729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.142950 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143254 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.143993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.144201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.144301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.144515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.144617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.144818 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.144915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.145130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.145218 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.145441 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.145566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.145765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.145876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146074 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146178 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146373 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.146976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.147070 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.147318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.147424 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.147619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.147904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.148093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.148240 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.148469 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.149175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.149304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.149498 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.149611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.149816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.149924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.150136 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.150231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.150454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.150548 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.150769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.150874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.151084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.151185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.151391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.151481 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.151722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.151831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.152953 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.153067 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.153264 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.153387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.153567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.153705 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.153876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.154022 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.154178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.154340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.154492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.154698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.154793 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.155014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.155151 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.155323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.155592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.155732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.155823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.156523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.156638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.156745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.156913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157276 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157361 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157545 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.157907 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.158111 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.158206 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.158427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.158526 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.158734 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.158834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159357 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159457 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.159998 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.160092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.160300 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.160403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.160610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.160712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.160913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.161141 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.161235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.161468 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.161561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.161805 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.161898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.162117 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.162208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.162418 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.162513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.162734 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.162855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163451 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.163973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.164106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.164299 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.164399 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.164599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.164699 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.164900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.165979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.166126 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.166232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.166425 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.166520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.166728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.166962 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.167064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.167320 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.167412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.167640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.167823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.167996 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.168108 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.168309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.168416 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.168621 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.168729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.168932 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169343 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169546 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169659 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.169956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.170149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.170247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.170461 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.170569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.170764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.170856 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.171070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.171169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.171370 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.171465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.171717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.171831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172111 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172429 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172741 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.172960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173060 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173360 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173574 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.173974 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.174179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.174274 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.174482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.174578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.174788 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.174889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.175094 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.175185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.175398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.175498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.175746 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.175866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.176958 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177670 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177875 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.177979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.178176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.178265 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.178498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.178590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.178807 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.178897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.179110 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.179193 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.179418 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.179509 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.179814 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.179936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.180097 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.180217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.180413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.180540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.180764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.180889 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.181085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.181213 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.181427 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.181630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.181734 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.181968 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.182069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.182289 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.182390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.182615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.182715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.182926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183019 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183322 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183535 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.183965 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.184199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.184302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.184515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.184609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.184832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185005 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185438 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.185942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186531 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186654 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.186975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.187080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.187274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.187368 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.187583 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.187720 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.187923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188238 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188650 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188898 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.188991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.189219 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.189319 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.189538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.189632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.189855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.189947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.190174 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.190268 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.190486 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.190587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.190798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.190892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.191107 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.191208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.191414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.191515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.191754 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.191878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192389 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192786 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.192993 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.193204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.193298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.193519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.193619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.193842 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.193949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.194167 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.194261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.194482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.194617 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.194808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.194940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.195135 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.195251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196000 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196106 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196677 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.196961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197603 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197905 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.197998 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.198224 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.198318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.198526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.198625 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.198831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.198924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.199138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.199230 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.199448 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.199550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.199773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.199871 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200076 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200682 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200781 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.200986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.201078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.201295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.201397 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.201602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.201705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.201913 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202518 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202624 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202824 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.202918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.203120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.203218 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.203422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.203527 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.203740 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.203834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204046 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204664 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.204971 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205581 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205674 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205886 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.205981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.206222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.206334 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.206611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.206713 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.206845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.206947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.207166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.207264 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.207467 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.207561 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.207793 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.207908 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.208104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.208205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.208405 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.208504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.208707 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.208809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209618 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.209920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210015 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210313 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210541 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210852 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.210985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.211726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.211822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212040 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212136 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.212947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.213043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.213288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.213381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.213590 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.213683 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.213922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214015 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214331 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214880 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.214973 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.215190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.215289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.215505 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.215612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.215843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.215946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.216158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.216269 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.216471 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.216584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.216780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.216870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.217092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.217192 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.217403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.217502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.217714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.217808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218442 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218738 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.218963 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.219063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.219292 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.219488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.219639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.219841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.219991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.220156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.220308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.220465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.220624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.220780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.220932 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.221091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.221193 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117878) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:01:13.221402 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.221713 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.222022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.222330 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.222640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.222964 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.223282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.223604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.223979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.224293 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.224607 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.224919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.225229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.225583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.225894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.226197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.226547 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.226872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.227183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.227492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.227825 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.228137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.228450 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.228761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.229069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.229381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.229692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.230016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.230348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.230674 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.230986 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.231297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.231610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.232175 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.232499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.232834 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.233259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.233591 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.233909 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.234227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.234555 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.234862 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.235166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.235481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.235819 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.236123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.236477 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.236758 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.237064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.237381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.237692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.238224 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.238571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.238885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.239210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.239534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.239881 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.240192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.240520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.240824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.241130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.241446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.241756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.242057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.242400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.242710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.243017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.243319 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.243628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.243955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.244537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.244840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.245144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.245446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.245757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.246060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.246378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.246670 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.246970 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.247279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.247579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.247963 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.248267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.248576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.248879 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.249188 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.249530 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.249855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.250159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.250465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.250778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.251089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.251411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.251743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.252054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.252401 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.252719 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.253255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.253586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.253904 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.254234 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.254561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.254865 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.255168 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.255471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.255827 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.256139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.256450 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.256761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.257074 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.257384 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.257692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.258517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.258828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.259138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.259446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.259777 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.260086 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.260393 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.260710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.261048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.261366 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.261679 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.261992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.262306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.262615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.262923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.263228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.263534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.263876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.264205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.264514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.264816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.265316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.265625 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.265941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.266259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.266567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.266885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.267204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.267514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.267858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.268168 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.268499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.268833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.269160 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.269481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.269783 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.270084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.270385 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.270696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.271012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.271317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.271618 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.271941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.272252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.272554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.272857 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.273159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.273515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.274315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.274616 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.274918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.275220 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.275521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.275848 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.276146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.276453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.276755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.277058 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.277358 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.277661 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.277960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.278289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.278617 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.278929 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.279250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.279557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.279902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.280215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.280541 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.280860 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.281173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.281482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.281812 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.282121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.282429 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.282738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.283046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.283353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.283671 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.283873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO dbcounter [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Registered counter for database nova_api Jun 23 11:01:13.284019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.284315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.284619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.284942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.285255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.285573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.285888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.286196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.286522 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.286833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.287140 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.287451 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.287789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.288097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.288410 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.288727 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.289070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.289391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.289699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.290022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.290351 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.290695 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.291003 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.291342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.291690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.291998 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.292307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.292608 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:01:13.292847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117877) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:01:13.304121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_db.sqlalchemy.engines [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.310680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writer thread running {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.354877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Registered counter for database nova_api Jun 23 11:01:13.367244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.context [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39972d54-8889-44dd-a663-db2f8dbec8fc(cell1) {{(pid=117878) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:01:13.371576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.373201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.373999 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.376010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.378014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO dbcounter [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Registered counter for database nova_cell0 Jun 23 11:01:13.381684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.382097 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO dbcounter [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Registered counter for database nova_cell1 Jun 23 11:01:13.389058 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.390047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_db.sqlalchemy.engines [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.392007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_db.sqlalchemy.engines [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.403570 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writer thread running {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.405841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writer thread running {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.448044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.context [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),39972d54-8889-44dd-a663-db2f8dbec8fc(cell1) {{(pid=117877) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:01:13.452128 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.453726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.454521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:01:13.456514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:01:13.458538 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Registered counter for database nova_cell0 Jun 23 11:01:13.462500 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Registered counter for database nova_cell1 Jun 23 11:01:13.469829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.471475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.477454 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.479525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.556318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO dbcounter [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Registered counter for database nova_cell0 Jun 23 11:01:13.563825 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_db.sqlalchemy.engines [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117878) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.568416 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writer thread running {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.629524 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO dbcounter [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Registered counter for database nova_cell0 Jun 23 11:01:13.636972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_db.sqlalchemy.engines [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117877) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:01:13.641701 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writer thread running {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:01:13.889776 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: WARNING keystonemiddleware.auth_token [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:01:13.897119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: WARNING keystonemiddleware.auth_token [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:01:13.962936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:01:13.970523 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:01:14.238048 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: WARNING keystonemiddleware.auth_token [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:01:14.244650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: WARNING keystonemiddleware.auth_token [None req-fbb78647-eadd-4a50-921d-7511e02c8caf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:01:14.250138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55618b8179c0 pid: 117878 (default app) Jun 23 11:01:14.313077 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:01:14.319071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: WARNING keystonemiddleware.auth_token [None req-a56e80f9-1696-4da4-b7a6-516a11b7e727 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:01:14.324557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55618b8179c0 pid: 117877 (default app) Jun 23 11:01:52.781261 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:52.782464 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:52.783351 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:52.784258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:53.776452 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6809a865-8f0a-4726-aebf-ef77443965c7 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Action: 'create', calling method: .version_select at 0x7f089e763700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1841475078", "metadata": {"Type": "work"}}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6809a865-8f0a-4726-aebf-ef77443965c7 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Request method failure captured: Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 122 Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEggbrDS99ZvC7Yt6CT6bGoDJ95ROO5i8vJ2tPTQRp8vgN2UDt3ms3xz1uITFz2xjfXCV2onSaLYQNhQvfPVaXsYGI_-mqs3SHfnkrj6-1Uk1cnwiOnpk8J0IohOvHO4jrEwsLlX7IxyAGBblLjtb0XQAGjzSATBmlY16v-0EKqrm_A Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:01:53.789804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82a06041149a40a6807070f31cf7225e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82a06041149a40a6807070f31cf7225e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 800e9640bdab42bb9a8ea58eecc71653 Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1841475078", "metadata": {"Type": "work"}}} Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: Jun 23 11:01:53.791965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1841475078', 'metadata': {'Type': 'work'}}}} Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise error Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:01:53.792840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 11:01:53.795461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 11:01:53.797930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 11:01:53.797930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:53.797930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6809a865-8f0a-4726-aebf-ef77443965c7 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:01:53.797930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6809a865-8f0a-4726-aebf-ef77443965c7 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.020174 Jun 23 11:01:53.797930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Jun 23 11:01:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1022 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:01:54.020639 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77ecbcc1-fac6-4941-8d21-d728ced24d00 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Action: 'create', calling method: .version_select at 0x7f089e7b1040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013932528", "metadata": {"Type": "work"}}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77ecbcc1-fac6-4941-8d21-d728ced24d00 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Request method failure captured: Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 120 Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEggbrDS99ZvC7Yt6CT6bGoDJ95ROO5i8vJ2tPTQRp8vgN2UDt3ms3xz1uITFz2xjfXCV2onSaLYQNhQvfPVaXsYGI_-mqs3SHfnkrj6-1Uk1cnwiOnpk8J0IohOvHO4jrEwsLlX7IxyAGBblLjtb0XQAGjzSATBmlY16v-0EKqrm_A Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:01:54.025236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82a06041149a40a6807070f31cf7225e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82a06041149a40a6807070f31cf7225e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 800e9640bdab42bb9a8ea58eecc71653 Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013932528", "metadata": {"Type": "work"}}} Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: Jun 23 11:01:54.026646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2013932528', 'metadata': {'Type': 'work'}}}} Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise error Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi '0' Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:01:54.027411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 11:01:54.028898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 11:01:54.030079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 11:01:54.030079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.030079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77ecbcc1-fac6-4941-8d21-d728ced24d00 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:01:54.030079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77ecbcc1-fac6-4941-8d21-d728ced24d00 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.226302 Jun 23 11:01:54.030079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 1/2] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Jun 23 11:01:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:01:54.041599 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cf81fe15-1604-4ab4-99d5-cae208535a45 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Action: 'create', calling method: .version_select at 0x7f089e6eba60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-969821159", "metadata": {"Type": "work"}}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cf81fe15-1604-4ab4-99d5-cae208535a45 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Request method failure captured: Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 118 Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEggbrDS99ZvC7Yt6CT6bGoDJ95ROO5i8vJ2tPTQRp8vgN2UDt3ms3xz1uITFz2xjfXCV2onSaLYQNhQvfPVaXsYGI_-mqs3SHfnkrj6-1Uk1cnwiOnpk8J0IohOvHO4jrEwsLlX7IxyAGBblLjtb0XQAGjzSATBmlY16v-0EKqrm_A Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:01:54.046267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82a06041149a40a6807070f31cf7225e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82a06041149a40a6807070f31cf7225e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 800e9640bdab42bb9a8ea58eecc71653 Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-969821159", "metadata": {"Type": "work"}}} Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: Jun 23 11:01:54.048122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-969821159', 'metadata': {'Type': 'work'}}}} Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise error Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi '' Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:01:54.049090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 11:01:54.050667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 11:01:54.052129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 11:01:54.052129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:54.052129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cf81fe15-1604-4ab4-99d5-cae208535a45 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:01:54.052129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cf81fe15-1604-4ab4-99d5-cae208535a45 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009477 Jun 23 11:01:54.056205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 2/3] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Jun 23 11:01:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:01:54.058097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:54.058980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:54.059715 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:54.060884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:54.066438 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-550c84e8-56ca-4af4-8912-c06c1e07838c tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Calling method '.version_select at 0x7f089ef8ec10>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:55.742622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-550c84e8-56ca-4af4-8912-c06c1e07838c tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] HTTP exception thrown: Volume tempest-invalid-870267718 could not be found. Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-550c84e8-56ca-4af4-8912-c06c1e07838c tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Request method failure captured: Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-870267718 HTTP/1.1 Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEggbrDS99ZvC7Yt6CT6bGoDJ95ROO5i8vJ2tPTQRp8vgN2UDt3ms3xz1uITFz2xjfXCV2onSaLYQNhQvfPVaXsYGI_-mqs3SHfnkrj6-1Uk1cnwiOnpk8J0IohOvHO4jrEwsLlX7IxyAGBblLjtb0XQAGjzSATBmlY16v-0EKqrm_A Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:01:55.747816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82a06041149a40a6807070f31cf7225e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82a06041149a40a6807070f31cf7225e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 800e9640bdab42bb9a8ea58eecc71653 Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Volume tempest-invalid-870267718 could not be found. Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': 'tempest-invalid-870267718'} Jun 23 11:01:55.749159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-870267718 could not be found. (HTTP 404) (Request-ID: req-d2f02f45-18fd-4779-aa12-97eef5850c89) Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:55.749914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:01:55.751084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-870267718 could not be found. Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:01:55.752259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-870267718 could not be found. Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-870267718 could not be found. Jun 23 11:01:55.754187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:55.757004 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-550c84e8-56ca-4af4-8912-c06c1e07838c tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Returning 404 to user: Volume tempest-invalid-870267718 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:01:55.759023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-550c84e8-56ca-4af4-8912-c06c1e07838c tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-870267718" status: 404 len: 98 microversion: 2.1 time: 1.701952 Jun 23 11:01:55.764455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1214 bytes} [Thu Jun 23 11:01:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-870267718 => generated 98 bytes in 1705 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 23 11:01:55.770256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ac7e07ca-0326-48d4-a954-e3cfb6cfa7e8 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004778 Jun 23 11:01:55.774685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1139 bytes} [Thu Jun 23 11:01:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 11:01:55.792352 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-600a88b6-4388-4d97-87c2-2ce2cb7eda0e tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015220 Jun 23 11:01:55.796685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1136 bytes} [Thu Jun 23 11:01:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 11:01:55.803903 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ceb985b3-40a0-4664-a45f-910fb1c3ff49 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Calling method '.version_select at 0x7f089e763ca0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:56.805537 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-ceb985b3-40a0-4664-a45f-910fb1c3ff49 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] HTTP exception thrown: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ceb985b3-40a0-4664-a45f-910fb1c3ff49 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Request method failure captured: Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/os-volumes/0d2fa111-3cea-4f36-9b8c-82f066553896 HTTP/1.1 Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEggbrDS99ZvC7Yt6CT6bGoDJ95ROO5i8vJ2tPTQRp8vgN2UDt3ms3xz1uITFz2xjfXCV2onSaLYQNhQvfPVaXsYGI_-mqs3SHfnkrj6-1Uk1cnwiOnpk8J0IohOvHO4jrEwsLlX7IxyAGBblLjtb0XQAGjzSATBmlY16v-0EKqrm_A Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:01:56.809680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82a06041149a40a6807070f31cf7225e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82a06041149a40a6807070f31cf7225e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 800e9640bdab42bb9a8ea58eecc71653 Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '0d2fa111-3cea-4f36-9b8c-82f066553896'} Jun 23 11:01:56.810988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. (HTTP 404) (Request-ID: req-b7fa3965-e7b7-46e0-83a8-5a0a3d2283b9) Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:56.811854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:01:56.813622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:01:56.814873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ceb985b3-40a0-4664-a45f-910fb1c3ff49 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Returning 404 to user: Volume 0d2fa111-3cea-4f36-9b8c-82f066553896 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ceb985b3-40a0-4664-a45f-910fb1c3ff49 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/0d2fa111-3cea-4f36-9b8c-82f066553896" status: 404 len: 109 microversion: 2.1 time: 1.013478 Jun 23 11:01:56.817007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:01:55 2022] DELETE /compute/v2.1/os-volumes/0d2fa111-3cea-4f36-9b8c-82f066553896 => generated 109 bytes in 1015 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:01:56.821840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eda081ed-948e-43f1-bd8f-78b05c1d4c82 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Calling method '.version_select at 0x7f089e7b1dc0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:01:57.137811 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-eda081ed-948e-43f1-bd8f-78b05c1d4c82 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] HTTP exception thrown: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eda081ed-948e-43f1-bd8f-78b05c1d4c82 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Request method failure captured: Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/6e246d5f-e7be-44c1-9747-35d7a65f17e4 HTTP/1.1 Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEggbrDS99ZvC7Yt6CT6bGoDJ95ROO5i8vJ2tPTQRp8vgN2UDt3ms3xz1uITFz2xjfXCV2onSaLYQNhQvfPVaXsYGI_-mqs3SHfnkrj6-1Uk1cnwiOnpk8J0IohOvHO4jrEwsLlX7IxyAGBblLjtb0XQAGjzSATBmlY16v-0EKqrm_A Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:01:57.140745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/82a06041149a40a6807070f31cf7225e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_82a06041149a40a6807070f31cf7225e", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/82a06041149a40a6807070f31cf7225e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 82a06041149a40a6807070f31cf7225e Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesNegativeTest-2040673467 Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 800e9640bdab42bb9a8ea58eecc71653 Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesNegativeTest-2040673467-project Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '6e246d5f-e7be-44c1-9747-35d7a65f17e4'} Jun 23 11:01:57.142348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. (HTTP 404) (Request-ID: req-c4681e49-1628-490a-b83c-193025161f3c) Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:57.143364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:01:57.144773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:01:57.146146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eda081ed-948e-43f1-bd8f-78b05c1d4c82 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] Returning 404 to user: Volume 6e246d5f-e7be-44c1-9747-35d7a65f17e4 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eda081ed-948e-43f1-bd8f-78b05c1d4c82 tempest-VolumesNegativeTest-2040673467 tempest-VolumesNegativeTest-2040673467-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/6e246d5f-e7be-44c1-9747-35d7a65f17e4" status: 404 len: 109 microversion: 2.1 time: 0.325131 Jun 23 11:01:57.147486 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:01:56 2022] GET /compute/v2.1/os-volumes/6e246d5f-e7be-44c1-9747-35d7a65f17e4 => generated 109 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:02:09.182114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cecf232d-df16-44c7-91d7-b37ace7af1f3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: .version_select at 0x7f089e6eb8b0>, body: {"keypair": {"name": "tempest-keypair-1869964053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVl8CGKQJvMJuaZWMb4xy579GKQBQvLtlpncoTHGrFrjcY3xs0BDCY7v8O0wZ1/PJkJKB6wUHydVt3Mx7kKy4XVt13bWHvQ2yzU1z9fTWKYef27A5QkHRaw4u87uhGxig=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:09.305706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-cecf232d-df16-44c7-91d7-b37ace7af1f3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:09.316670 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-cecf232d-df16-44c7-91d7-b37ace7af1f3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:09.436057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cecf232d-df16-44c7-91d7-b37ace7af1f3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.909954 Jun 23 11:02:09.437110 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 5/9] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:02:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:12.752395 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1406291601", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "networks": [{"uuid": "5ce35988-2c03-4f61-9713-c6c5b05f38b5"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:13.080074 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] validate_networks() for [('5ce35988-2c03-4f61-9713-c6c5b05f38b5', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:14.160521 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-729675478", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b879fb0c-6f1b-457c-8797-97d9533d8257"}], "security_groups": [{"name": "tempest-securitygroup--2046657702"}], "key_name": "tempest-keypair-1869964053", "user_data": "}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:14.521265 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] validate_networks() for [('b879fb0c-6f1b-457c-8797-97d9533d8257', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:16.774452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:16.774956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:16.775405 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:16.775853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:16.776269 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:16.810969 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:16.813223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:16.820575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:16.821087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:16.905620 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Getting quotas for project c6c6487f3e094808b1665bdd93da9b3c. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:16.942758 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Getting quotas for user f6390dc942db430e8dd648901900432b and project c6c6487f3e094808b1665bdd93da9b3c. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:16.974177 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:16.978304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:17.123168 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b2ef00c-fbc0-493c-87ce-5fc3aeda60b6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.436974 Jun 23 11:02:17.124209 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 5/10] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 5439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:02:17.150644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:17.151166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:17.151576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:17.152212 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:17.152624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:17.162829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:17.164061 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:17.165190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:17.165783 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:17.191735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:17.198304 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:17.220396 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:17.224889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:17.391956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-40c0ae6f-5ad1-4aee-80a7-a55baea34509 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.236149 Jun 23 11:02:17.397964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 6/11] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:02:17.726533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0458b1b4-e2ea-409d-84e2-a54f305484ce tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: .version_select at 0x7f089e4ba4c0>, body: {"keypair": {"name": "tempest-keypair-1289128500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH5ligjR91i4sLfTdNIfgN0HvK82MNMQXqoSSPozfrA3UrLHpqvJXm9fjjC3I033U0G4rrYWCdtgc1evRFPK4oHo7UP9RHbpoCiSPNsBJ51WN56d1HDQZ4e5zV5cpVneg=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:17.784294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-0458b1b4-e2ea-409d-84e2-a54f305484ce tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:17.796313 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-52050870", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:17.799596 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-0458b1b4-e2ea-409d-84e2-a54f305484ce tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for user 303e8aae1bd04228bedb145dec891a3e and project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:17.903601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0458b1b4-e2ea-409d-84e2-a54f305484ce tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.777059 Jun 23 11:02:17.904956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 6/12] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:02:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:17.918496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] validate_networks() for [('19e128cb-e174-49db-a8d2-8534db57c32e', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:17.924566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b509cabe-d27a-4190-bad0-3ada2faaa751 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:17.925456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b509cabe-d27a-4190-bad0-3ada2faaa751 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:18.234411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b509cabe-d27a-4190-bad0-3ada2faaa751 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:18.262776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b509cabe-d27a-4190-bad0-3ada2faaa751 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1215 microversion: 2.1 time: 0.355551 Jun 23 11:02:18.276929 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:17 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1215 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:18.284834 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-662ff6e2-b2d8-49de-bc21-904c81554b67 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:18.287579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-662ff6e2-b2d8-49de-bc21-904c81554b67 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:18.375144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-662ff6e2-b2d8-49de-bc21-904c81554b67 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:18.383272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-662ff6e2-b2d8-49de-bc21-904c81554b67 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1241 microversion: 2.1 time: 0.105189 Jun 23 11:02:18.384255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 8/14] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:18 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:19.281400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cd743484-ef7f-4421-970a-baf4493dbb72 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:19.281975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cd743484-ef7f-4421-970a-baf4493dbb72 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:19.367468 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:19.367978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:19.368574 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:19.368990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:19.369420 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:19.397089 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:19.400590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:19.401685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:19.402358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:19.445579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:19.457894 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for user 6bb5a1f18dff4395bec9c205a9937493 and project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:19.489513 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cd743484-ef7f-4421-970a-baf4493dbb72 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:19.494968 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:19.501522 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cd743484-ef7f-4421-970a-baf4493dbb72 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1215 microversion: 2.1 time: 0.225308 Jun 23 11:02:19.502137 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:19.515687 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 9/15] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:19 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:19.533303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a88102d6-5cb9-49ad-8a36-a95ceea9708c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:19.533919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a88102d6-5cb9-49ad-8a36-a95ceea9708c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:19.659069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-77ce9e6e-d6d5-451a-b136-81fd6929fbdb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.259461 Jun 23 11:02:19.660050 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 7/16] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:02:19.673821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cbc579d1-e738-4037-b238-0b31b919d3f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:19.679644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cbc579d1-e738-4037-b238-0b31b919d3f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:19.947382 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cbc579d1-e738-4037-b238-0b31b919d3f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:19.985039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cbc579d1-e738-4037-b238-0b31b919d3f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1220 microversion: 2.1 time: 0.317265 Jun 23 11:02:19.999921 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 8/17] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:19 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1220 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:20.406443 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1679770700", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:20.565478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a88102d6-5cb9-49ad-8a36-a95ceea9708c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:20.579182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a88102d6-5cb9-49ad-8a36-a95ceea9708c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1241 microversion: 2.1 time: 1.060939 Jun 23 11:02:20.582345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 10/18] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:19 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1241 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:20.587498 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] validate_networks() for [('19e128cb-e174-49db-a8d2-8534db57c32e', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:20.598976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:20.599604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:20.639952 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:20.640566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:20.641568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:20.642019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:21.165494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:21.187308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bcb48efa-4637-4931-829b-3bd5c72cfc77 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1219 microversion: 2.1 time: 0.603133 Jun 23 11:02:21.189960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 11/19] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:20 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1219 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:21.599010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:21.599685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:21.615069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:21.617951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:21.618944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:21.619542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:21.918390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:21.927047 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c7463b5e-000c-4395-976f-97741b25b98c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1293 microversion: 2.1 time: 0.332596 Jun 23 11:02:21.939463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 12/20] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:21 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1293 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:21.986221 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:21.986846 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:21.987469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:21.987469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:21.987913 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:22.015736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.016276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.017217 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.020432 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.061661 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:22.071769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for user 6bb5a1f18dff4395bec9c205a9937493 and project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:22.117118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:22.126927 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:22.206240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:22.207259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:22.216615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.218858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.223512 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.224313 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.231590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cea01685-6796-4ae0-bbbd-9c1d5181d500 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.829922 Jun 23 11:02:22.237308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 9/21] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:02:22.252952 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-eb8c5751-7d50-474f-a18a-361e43962478 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:22.260348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-eb8c5751-7d50-474f-a18a-361e43962478 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:22.411021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:22.438803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8dc15d5b-33d1-4906-ad44-1e1e163d3067 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1275 microversion: 2.1 time: 0.233343 Jun 23 11:02:22.453161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 13/22] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:22 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:22.565665 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-eb8c5751-7d50-474f-a18a-361e43962478 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:22.573750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-eb8c5751-7d50-474f-a18a-361e43962478 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1222 microversion: 2.1 time: 0.330763 Jun 23 11:02:22.577133 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 10/23] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:22 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1222 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:22.944191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:22.944997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:22.953317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.953778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:22.955731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:22.956428 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:23.444971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:23.458483 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:23.459131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:23.468453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4bd54ccf-c5d6-4122-8ded-bb3ce9b1f09c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1299 microversion: 2.1 time: 0.528327 Jun 23 11:02:23.468616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:23.476450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:23.477384 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:23.477895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:23.479610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 14/24] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:22 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1299 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:23.602016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:23.604811 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:23.614087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:23.651727 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:23.674146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:23.674678 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:23.925465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:23.971339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e6d5be8e-c2d3-4cdd-be7c-15265fbad764 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1273 microversion: 2.1 time: 0.516680 Jun 23 11:02:23.972236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 11/25] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:23 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1273 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:24.004541 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:24.035052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ee3588a-c96d-467d-bb5f-2ae45b92fe51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1218 microversion: 2.1 time: 0.442081 Jun 23 11:02:24.036579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 15/26] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:23 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1218 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:24.485192 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:24.486766 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:24.504054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:24.510118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:24.519158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:24.522047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:24.759283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:24.766915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-77968d2e-55e2-4c45-893c-33cb74096465 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1299 microversion: 2.1 time: 0.285399 Jun 23 11:02:24.776027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 12/27] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:24 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:24.990294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:24.990916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:25.003845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.005525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.008599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.009272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.053367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:25.054899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:25.061920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.071060 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.073663 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.079763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.726345 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:25.764505 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-920f5ea2-10da-4295-8d64-43e6639662c3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1280 microversion: 2.1 time: 0.705418 Jun 23 11:02:25.769208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 13/28] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:25 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1280 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:25.795041 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:25.799850 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:25.825388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.826943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:25.829892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:25.830352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:26.096139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:26.116467 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-562b7baf-8849-4107-9961-0bdda0ec2cad tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1273 microversion: 2.1 time: 1.130433 Jun 23 11:02:26.117057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 16/29] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:24 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1273 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:26.135079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:26.165084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d0d34824-ac52-4e56-aabf-3dcd36bce855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1299 microversion: 2.1 time: 0.370989 Jun 23 11:02:26.171803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 14/30] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:25 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1299 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:26.791582 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:26.792729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:26.810062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:26.813537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:26.819950 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:26.820471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:26.872514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:27.153907 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:27.154625 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:27.179330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:27.181565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:27.187629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:27.190126 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:27.196730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:27.209296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-67f2d7c1-0eeb-4f0b-987f-8a6035e24886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1280 microversion: 2.1 time: 0.426991 Jun 23 11:02:27.217840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 17/31] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:26 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1280 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:27.236614 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:27.237792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:27.262649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:27.264226 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:27.274396 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:27.275158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:28.528344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:28.543781 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-84f96175-7a7d-4ddc-8da0-459161f3ae38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 1.318249 Jun 23 11:02:28.544975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 18/32] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:27 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:28.558903 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1528564888", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f66c2d2-ea10-4014-ae5f-f902d520ab2d"}], "security_groups": [{"name": "tempest-securitygroup--436403022"}], "key_name": "tempest-keypair-1289128500", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:28.709283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:28.745415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-89c27850-9629-4ae2-bee8-3d583e01f0b5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 1.611112 Jun 23 11:02:28.753959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:27 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:28.775680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:28.780623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:28.796436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:28.797149 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:28.801868 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:28.806567 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:29.059785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:29.069591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-207f99da-bc1b-4de8-9ce9-22f928d37be4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1280 microversion: 2.1 time: 0.311661 Jun 23 11:02:29.080192 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 16/34] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:28 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1280 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:29.135932 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] validate_networks() for [('2f66c2d2-ea10-4014-ae5f-f902d520ab2d', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:29.563239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:29.563893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:29.571841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:29.572309 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:29.581406 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:29.587831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:30.570451 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=18 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:31.230750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:31.240336 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d9fac20e-8e71-489c-b7dc-46dcd01aa02f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 1.681506 Jun 23 11:02:31.252197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 17/35] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:29 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:31.257649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:31.258277 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:31.281206 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:31.288084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:31.289042 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:31.289668 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.048203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=6 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:32.363046 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:32.378216 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fec9488c-2447-421a-982b-700b78b8909f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 1.124856 Jun 23 11:02:32.390035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 18/36] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:31 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:32.402602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:32.403632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:32.410406 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:32.411208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.412134 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:32.419470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.581493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=26 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:32.646627 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:32.647243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:32.647956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:32.648485 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:32.649533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:32.671418 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:32.672733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.674855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:32.675612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:32.701367 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:32.705649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for user 303e8aae1bd04228bedb145dec891a3e and project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:32.717659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:32.720163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:32.791281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1091c9e6-6c75-44fd-92e7-0191de47857e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.243110 Jun 23 11:02:32.793528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 19/37] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 4247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:02:32.963473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ebdcaece-66b3-4852-894b-68e9beabda82 req-ef8b954c-2f0b-40ca-9437-e483b206ca03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2946bfb4-cd02-4237-8291-ad974a96ded6", "tag": "7c27c36f-56fd-4d7b-b077-2903298e9c9c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:33.010044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ebdcaece-66b3-4852-894b-68e9beabda82 req-ef8b954c-2f0b-40ca-9437-e483b206ca03 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:33.010532 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ebdcaece-66b3-4852-894b-68e9beabda82 req-ef8b954c-2f0b-40ca-9437-e483b206ca03 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:33.056465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ebdcaece-66b3-4852-894b-68e9beabda82 req-ef8b954c-2f0b-40ca-9437-e483b206ca03 service nova] Creating event network-changed:7c27c36f-56fd-4d7b-b077-2903298e9c9c for instance 2946bfb4-cd02-4237-8291-ad974a96ded6 on hv-cinder-84330 Jun 23 11:02:33.057048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ebdcaece-66b3-4852-894b-68e9beabda82 req-ef8b954c-2f0b-40ca-9437-e483b206ca03 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 11:02:33.058208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:33.068559 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:33.069707 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:33.070312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:33.114290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.compute.rpcapi [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 11:02:33.117367 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] Releasing lock "compute-rpcapi-router" {{(pid=117877) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 11:02:33.165818 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-078c0c44-3fd1-4798-a49f-6e89aeefb95e None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369882 Jun 23 11:02:33.166581 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 20/38] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:33.620489 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-5782e259-1919-4933-afb3-31d06b5a61d6 req-e0e6d7e4-6954-4533-976f-602d289c6670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e40b529-165d-4f7f-8768-5f2ed22815b4", "tag": "bf647141-29b7-47c1-a7c3-6e9e399350c6"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:33.644597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5782e259-1919-4933-afb3-31d06b5a61d6 req-e0e6d7e4-6954-4533-976f-602d289c6670 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:33.650886 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5782e259-1919-4933-afb3-31d06b5a61d6 req-e0e6d7e4-6954-4533-976f-602d289c6670 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:33.687419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-5782e259-1919-4933-afb3-31d06b5a61d6 req-e0e6d7e4-6954-4533-976f-602d289c6670 service nova] Creating event network-changed:bf647141-29b7-47c1-a7c3-6e9e399350c6 for instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 on hv-cinder-84330 Jun 23 11:02:33.729304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-5782e259-1919-4933-afb3-31d06b5a61d6 req-e0e6d7e4-6954-4533-976f-602d289c6670 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.560477 Jun 23 11:02:33.729924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 21/39] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:33.742128 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:33.742848 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:33.787637 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:33.796631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:33.808973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:33.809444 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:34.113878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:34.121518 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e599e72c-4d47-4178-8e50-ba58ad876236 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 1.729738 Jun 23 11:02:34.125044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 19/40] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:32 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:34.142584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:34.144869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:34.167761 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:34.168326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:34.169262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:34.170103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:34.316368 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:34.327332 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-06c4d3c2-2742-4a7f-a8f6-e6bb096ca83c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1242 microversion: 2.1 time: 0.198717 Jun 23 11:02:34.328456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 20/41] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:34 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1242 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:34.342632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:34.343609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:34.353469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:34.354042 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:34.355022 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:34.355490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:34.705341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:34.716945 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bedb2336-a62b-4213-9187-1ab301af6ea3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.979297 Jun 23 11:02:34.718123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 22/42] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:33 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:34.763991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:34.807087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e27721a7-2905-45aa-8708-51b8179c3e21 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.465348 Jun 23 11:02:34.820761 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 21/43] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:34 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:35.138933 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:35.139720 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:35.147027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.148298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.149389 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.151558 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.251318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-5a08c1ee-7400-4aea-a99f-2591312ad1b7 req-e6b55c2c-cf63-4524-aa82-f7484ac7f9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c6bdb0-09d8-496b-998a-c2a4252c5772", "tag": "88802b38-9718-44af-a9c0-e377da1fdee6"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:35.275848 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5a08c1ee-7400-4aea-a99f-2591312ad1b7 req-e6b55c2c-cf63-4524-aa82-f7484ac7f9da service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.276726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5a08c1ee-7400-4aea-a99f-2591312ad1b7 req-e6b55c2c-cf63-4524-aa82-f7484ac7f9da service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.296682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-5a08c1ee-7400-4aea-a99f-2591312ad1b7 req-e6b55c2c-cf63-4524-aa82-f7484ac7f9da service nova] Creating event network-changed:88802b38-9718-44af-a9c0-e377da1fdee6 for instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 on hv-cinder-84330 Jun 23 11:02:35.297295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5a08c1ee-7400-4aea-a99f-2591312ad1b7 req-e6b55c2c-cf63-4524-aa82-f7484ac7f9da service nova] Acquired lock "compute-rpcapi-router" {{(pid=117878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 11:02:35.298434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.298871 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.299680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.300768 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.312353 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.compute.rpcapi [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 11:02:35.313869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117878) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 11:02:35.343822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-29506068-ca0d-43f7-898a-52e7ba8a25b5 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096460 Jun 23 11:02:35.343822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 22/44] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:35.349929 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:35.350655 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:35.358561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:35.365891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.366837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.367114 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1bbc6fe-4d38-4951-8fe3-e37548037c1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.232319 Jun 23 11:02:35.367749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 23/45] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:35 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:35.368423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.369098 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.491964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:35.515285 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6dc8ac20-d252-4740-b191-d20432ceab1e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1242 microversion: 2.1 time: 0.170196 Jun 23 11:02:35.517663 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 23/46] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:35 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1242 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:35.734407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:35.735015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:35.741537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.741995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.742751 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.743351 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.770377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-4b08eb4f-0426-4ba1-bd26-39a1834ef014 req-d8f6b3b3-f5d1-4e0a-baa5-032e0c7426d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd22d66-6c09-4099-8205-5eec0effaeb6", "tag": "9a1f5b7e-89bf-488e-990f-34a0baf9914f"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:35.779599 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-4b08eb4f-0426-4ba1-bd26-39a1834ef014 req-d8f6b3b3-f5d1-4e0a-baa5-032e0c7426d5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.780533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-4b08eb4f-0426-4ba1-bd26-39a1834ef014 req-d8f6b3b3-f5d1-4e0a-baa5-032e0c7426d5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.798159 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-4b08eb4f-0426-4ba1-bd26-39a1834ef014 req-d8f6b3b3-f5d1-4e0a-baa5-032e0c7426d5 service nova] Creating event network-changed:9a1f5b7e-89bf-488e-990f-34a0baf9914f for instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 on hv-cinder-84330 Jun 23 11:02:35.803104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-4b08eb4f-0426-4ba1-bd26-39a1834ef014 req-d8f6b3b3-f5d1-4e0a-baa5-032e0c7426d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037721 Jun 23 11:02:35.804861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 24/47] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:02:35.848752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:35.848752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:35.853022 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:35.857123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.858171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.859077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:35.859520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:35.913094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:35.921217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9540239d-d7d3-4ef0-b765-09e4acde92e0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.190568 Jun 23 11:02:35.922103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:35 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:36.021310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:36.029764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-45d890f8-698a-4e3b-b0ef-4ee4b9dae4f7 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.205949 Jun 23 11:02:36.030327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 25/49] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:35 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:36.384746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:36.385355 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:36.391487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:36.392036 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:36.392745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:36.393345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:36.532784 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:36.533381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:36.547552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:36.548308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:36.549144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:36.549573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:36.557681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:36.566391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-680097ec-7bea-409f-958f-bba9f6ea8cd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.185714 Jun 23 11:02:36.566961 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 25/50] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:36 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:36.628075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:36.635959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e552d023-9795-43f9-b620-b423e6e3f3ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1242 microversion: 2.1 time: 0.106938 Jun 23 11:02:36.636939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 26/51] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:36 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:36.941599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:36.943011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:36.949243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:36.950038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:36.950816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:36.951259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.052816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:37.054651 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:37.073338 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:37.074918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.076760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:37.077663 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.130135 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:37.189911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:37.205132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b6d1822a-f102-4e06-b6d2-9121067ee56b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.269178 Jun 23 11:02:37.205718 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 26/52] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:36 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:37.534925 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:37.543821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-897ad8c8-2ffb-4811-8e8b-4f5327587bf3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.500822 Jun 23 11:02:37.546156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 27/53] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:37 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:37.591718 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:37.592612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:37.605016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:37.605975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.606613 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:37.607054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.653971 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:37.654873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:37.666203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:37.666822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.667801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:37.669617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:37.758417 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:37.766632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cead21d5-22b5-4828-a290-9bcb099bc041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1242 microversion: 2.1 time: 0.116617 Jun 23 11:02:37.767198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 28/54] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:37 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:37.904170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:37.913267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-619bb98a-90b8-41d1-b131-8108182ad061 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.334403 Jun 23 11:02:37.914369 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 27/55] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:37 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:38.223777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:38.223777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:38.238406 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.238701 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.244120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.244671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.566846 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:38.569350 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:38.579799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.580593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.581938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.582837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.639729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:38.652270 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b55114e0-8f11-4eae-809b-b80af4deb3da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.430682 Jun 23 11:02:38.653154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 29/56] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:38 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:38.785348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:38.786177 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:38.795911 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.796874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.798035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.798665 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.880784 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:38.886071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:38.889672 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1c019e16-987c-4080-881f-ca7f16b84a19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1290 microversion: 2.1 time: 0.109797 Jun 23 11:02:38.890652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 30/57] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:38 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:38.894018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:38.899684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21cc0c00-ace7-44ac-ba99-c99b53abe45d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.341048 Jun 23 11:02:38.900641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 28/58] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:38 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:38.931221 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:38.931809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:38.938719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.939197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:38.940313 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:38.940961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:39.112523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:39.120545 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-528b18c7-0d97-4973-a70d-2aa7c98a93f9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.193992 Jun 23 11:02:39.121111 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 31/59] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:38 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:39.670714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:39.672015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:39.683977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:39.683977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:39.683977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:39.683977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:39.845782 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:39.855214 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a0796e7a-1622-43d9-b800-b39760713223 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.189674 Jun 23 11:02:39.856332 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 29/60] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:39 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:39.906797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:39.907431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:39.913540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:39.914208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:39.915132 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:39.915743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:39.916494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:39.917092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:39.919981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:39.924717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:39.925105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:39.925869 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:39.926296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:40.017993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:40.028885 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fd7b86fd-cb96-4fe2-aeaf-66f3e6b8378d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1290 microversion: 2.1 time: 0.125691 Jun 23 11:02:40.029901 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 32/61] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:39 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:40.116573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:40.126298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e5b70051-2a89-49fc-9ec6-2dd8dbb55045 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.213402 Jun 23 11:02:40.126855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 30/62] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:39 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:40.138001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:40.138602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:40.144415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:40.144856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:40.145668 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:40.146123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:40.283458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:40.291470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a50f82a8-656b-46fd-ae8b-088e631f372e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.157240 Jun 23 11:02:40.300628 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 33/63] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:40 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:40.873071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:40.874478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:40.881965 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:40.882791 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:40.883796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:40.884623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.051993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:41.051993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:41.086477 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:41.086914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.096921 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:41.097596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.152126 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:41.161568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-100fe39b-6ef3-4c54-9d3f-b5c55f372f36 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.292692 Jun 23 11:02:41.162690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 31/64] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:40 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:41.168272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:41.169064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:41.175988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:41.176569 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.177578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:41.178195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.337653 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:41.349854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-320ad987-703c-4f4b-af7a-5de5fefbf6a8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1290 microversion: 2.1 time: 0.307482 Jun 23 11:02:41.359728 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 34/65] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:41 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1290 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:41.365525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:41.367453 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:41.380906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:41.381348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.382817 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:41.386001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:41.399065 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:41.426241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eb4b4788-8a26-483b-96ed-7891b7d364a6 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.260750 Jun 23 11:02:41.426839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 32/66] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:41 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:41.638607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:41.646997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-443b9ac0-2c4c-4258-85c2-c4707a34acf7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.295041 Jun 23 11:02:41.651709 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 35/67] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:41 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:42.182287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:42.183509 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:42.195236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.195956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.197013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.197883 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.367708 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:42.369064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:42.377958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.378724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.379913 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.380563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.554641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:42.564104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e37a02ff-cc1b-4371-9fa3-c4bfea861b77 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1296 microversion: 2.1 time: 0.201100 Jun 23 11:02:42.565365 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 36/68] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:42 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1296 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:42.580175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:42.581229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:42.601473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.602059 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.602968 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.603702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.715041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:42.790923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:42.799818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9cb03792-f335-4816-907e-e027c35c4691 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.233128 Jun 23 11:02:42.800625 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 37/69] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:42 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:42.806437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:42.807035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:42.813024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.813566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.814664 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:42.815232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:42.907547 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:42.919112 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d6d15cb-9334-48c2-b54c-67a71e4b8294 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.744249 Jun 23 11:02:42.920077 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 33/70] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:42 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:43.039860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:43.047245 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a249c4ab-2ec4-4dd6-817d-efe78d1634fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.245361 Jun 23 11:02:43.047825 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 38/71] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:42 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:43.582177 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:43.582783 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:43.586211 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:43.590897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:43.591332 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:43.592320 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:43.592753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:43.659178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:43.667457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-792cac10-47fd-4a04-bb3f-a3db20712599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1296 microversion: 2.1 time: 0.088961 Jun 23 11:02:43.668082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 34/72] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:43 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:43.817602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:43.818210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:43.824849 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:43.825433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:43.826192 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:43.826622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:43.937482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:43.938362 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:43.946414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:43.946872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:43.947616 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:43.948239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:43.974271 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:43.981814 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-41c0a432-bd62-4eec-a567-5c9c3426042b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.168139 Jun 23 11:02:43.991926 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 39/73] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:43 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:44.064584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:44.065196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:44.072395 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:44.072841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:44.073601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:44.074027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:44.089904 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:44.100587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81462870-6130-440e-b0ad-c50af619d8da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.167268 Jun 23 11:02:44.102399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 35/74] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:43 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:44.205436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:44.213634 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a7f2df93-0fc8-47f4-a65f-f46504e1bc90 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.153039 Jun 23 11:02:44.214290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 40/75] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:44 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:44.685437 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:44.686115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:44.692055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:44.692514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:44.693279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:44.693709 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:44.755013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:44.762383 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2f60b772-d707-4dae-b2f8-3022a9c692b2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1296 microversion: 2.1 time: 0.081882 Jun 23 11:02:44.762938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 36/76] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:44 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:44.998473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:44.999089 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:45.005869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.007013 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.008165 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.008676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.117226 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:45.117854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:45.124339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.124785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.125544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.125970 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.148546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:45.156992 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ceef98d3-9929-4767-9933-a363d1713d75 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.162548 Jun 23 11:02:45.157785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 41/77] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:44 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:45.230399 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:45.231273 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:45.237826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.238276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.239227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.239720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.311251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:45.334687 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:45.345578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-23639d4a-9f08-4eb4-9918-800a2cdf422a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.232166 Jun 23 11:02:45.346770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 37/78] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:45 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:45.456314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:45.473181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7b3cf6c2-12ba-4664-bcf5-50949aac4f5a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.246761 Jun 23 11:02:45.473758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 42/79] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:45 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:45.779923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:45.781108 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:45.787419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.788122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.790187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:45.790769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:45.874154 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:45.883749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e58c39df-8388-410f-bfc2-def1b9c3ca80 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1296 microversion: 2.1 time: 0.106071 Jun 23 11:02:45.884805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 38/80] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:45 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:46.174205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:46.174821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:46.181407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.181859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.182612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.183049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.363141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:46.364233 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:46.376110 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.380558 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.381468 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.382577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.452822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:46.461034 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3533ef06-9bea-46f4-b2c5-756fb0539a23 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.290583 Jun 23 11:02:46.477909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 43/81] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:46 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:46.490061 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:46.491906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:46.500511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.502636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.504095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:46.508242 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:46.514482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:46.977936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:46.990696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83dbc3d5-ef08-491a-9c28-a0119413c356 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.631226 Jun 23 11:02:46.991946 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 39/82] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:46 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:47.075397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:47.098156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-df43857c-ef24-4912-adc3-511a0dd101b7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.612062 Jun 23 11:02:47.111591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 44/83] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:46 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:47.130604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:47.131245 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:47.149440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.152501 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:47.154263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.156158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:47.275124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c0ed18fe-27ac-4ae8-a1fb-be093bcb0260 req-bbdaa72e-a269-4de0-86df-69ba3decffe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2946bfb4-cd02-4237-8291-ad974a96ded6", "name": "network-vif-plugged", "status": "completed", "tag": "7c27c36f-56fd-4d7b-b077-2903298e9c9c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:47.284723 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c0ed18fe-27ac-4ae8-a1fb-be093bcb0260 req-bbdaa72e-a269-4de0-86df-69ba3decffe3 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.285308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c0ed18fe-27ac-4ae8-a1fb-be093bcb0260 req-bbdaa72e-a269-4de0-86df-69ba3decffe3 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:47.299150 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c0ed18fe-27ac-4ae8-a1fb-be093bcb0260 req-bbdaa72e-a269-4de0-86df-69ba3decffe3 service nova] Creating event network-vif-plugged:7c27c36f-56fd-4d7b-b077-2903298e9c9c for instance 2946bfb4-cd02-4237-8291-ad974a96ded6 on hv-cinder-84330 Jun 23 11:02:47.307242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c0ed18fe-27ac-4ae8-a1fb-be093bcb0260 req-bbdaa72e-a269-4de0-86df-69ba3decffe3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312245 Jun 23 11:02:47.310930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 40/84] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:47.472062 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:47.485131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-317005c3-40f3-4f0e-9284-a1a56b2fa599 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.366031 Jun 23 11:02:47.486568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:47.487911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:47.488200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 45/85] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:47 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:47.507012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.507473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:47.508390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:47.508870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:47.939565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:47.962798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fc48706-b4d2-4442-b6e6-acc906d06e66 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.481269 Jun 23 11:02:47.963805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 41/86] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:47 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:48.012418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:48.013208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:48.019941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.020622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.021632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.022795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.116488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:48.117760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:48.125460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.126130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.127100 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.127791 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.347889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:48.359641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-201ca436-a5af-4451-9771-c630c19f3eaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.351720 Jun 23 11:02:48.361886 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 46/87] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:48 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:48.433033 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-adf71090-3774-4731-bf37-6c42a9b38fa8 req-9ef1d59c-3a17-4e38-aabe-cdaeb3d9255e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d", "tag": "f38d95a7-ab3e-47d6-991b-c6ccc781d5fe"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:48.461821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-adf71090-3774-4731-bf37-6c42a9b38fa8 req-9ef1d59c-3a17-4e38-aabe-cdaeb3d9255e service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.462276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-adf71090-3774-4731-bf37-6c42a9b38fa8 req-9ef1d59c-3a17-4e38-aabe-cdaeb3d9255e service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.493738 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-adf71090-3774-4731-bf37-6c42a9b38fa8 req-9ef1d59c-3a17-4e38-aabe-cdaeb3d9255e service nova] Creating event network-changed:f38d95a7-ab3e-47d6-991b-c6ccc781d5fe for instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d on hv-cinder-84330 Jun 23 11:02:48.504860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-adf71090-3774-4731-bf37-6c42a9b38fa8 req-9ef1d59c-3a17-4e38-aabe-cdaeb3d9255e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074360 Jun 23 11:02:48.505742 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 47/88] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:48.511897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:48.512623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:48.533011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.533914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.534243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:48.534840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:48.597870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:48.606913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b73c1533-2195-451d-8bb7-d515e5980c2e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.494813 Jun 23 11:02:48.607895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 42/89] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:48 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:48.733461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:48.741666 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-379c4317-7fcf-4b11-9c46-a626cbdc18b7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.234267 Jun 23 11:02:48.742224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 48/90] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:48 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:48.982808 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:48.983776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:49.008561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.013813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.014749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.015350 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.312155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:49.324011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc8fcfb4-2f82-4159-abbc-4d9ea6b2b17d tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.347023 Jun 23 11:02:49.324890 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-ec4c7a0c-5729-46de-a843-06dd523e3550 req-30886504-2707-4436-8d38-f48d9000d13b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e40b529-165d-4f7f-8768-5f2ed22815b4", "name": "network-vif-plugged", "status": "completed", "tag": "bf647141-29b7-47c1-a7c3-6e9e399350c6"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:49.325268 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 43/91] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:48 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:49.337645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-ec4c7a0c-5729-46de-a843-06dd523e3550 req-30886504-2707-4436-8d38-f48d9000d13b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.338335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-ec4c7a0c-5729-46de-a843-06dd523e3550 req-30886504-2707-4436-8d38-f48d9000d13b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.357494 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-ec4c7a0c-5729-46de-a843-06dd523e3550 req-30886504-2707-4436-8d38-f48d9000d13b service nova] Creating event network-vif-plugged:bf647141-29b7-47c1-a7c3-6e9e399350c6 for instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 on hv-cinder-84330 Jun 23 11:02:49.364552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-ec4c7a0c-5729-46de-a843-06dd523e3550 req-30886504-2707-4436-8d38-f48d9000d13b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046093 Jun 23 11:02:49.365798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 49/92] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:49.377398 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:49.378826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:49.386257 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.386817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.387770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.388502 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.574977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:49.582463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39e1ca0d-871a-49d7-88b8-006e7d27463b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.208897 Jun 23 11:02:49.592254 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 44/93] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:49 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:49.625727 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:49.626974 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:49.638635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.639264 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.640174 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.640690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.761658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:49.762377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:49.768583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.769119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.769955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:49.770516 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:49.854921 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:49.864428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c7b3b4a8-6cad-4830-bb0e-bd8edd048239 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.243927 Jun 23 11:02:49.876085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 50/94] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:49 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:49.944738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:49.953412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2c2b939-573e-4dc3-9dc8-eb230ed4e041 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.198735 Jun 23 11:02:49.954675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 45/95] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:49 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:50.343970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:50.345454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:50.385429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.386089 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.390994 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.392731 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.598869 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:50.600359 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:50.613431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.613947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.615311 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.619026 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.630015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:50.729538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:50.750324 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d348cc06-f497-4d7d-82a2-1a2c0e5c93db tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.412512 Jun 23 11:02:50.754898 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 51/96] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:50 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:50.885339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:50.886151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:50.902397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.903279 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:50.904826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:50.905512 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.275503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:51.292289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d14381d3-b893-4193-a271-67edf3de400e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1367 microversion: 2.1 time: 0.697366 Jun 23 11:02:51.293318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 46/97] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:50 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:51.298137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:51.298741 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:51.313126 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.313884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.314737 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.315401 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.343919 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:51.353457 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8662fc7d-7ef9-403e-b1f1-6cd9943626a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.473286 Jun 23 11:02:51.365998 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 52/98] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:50 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:51.383518 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-ec80531d-cca8-48cf-b0fd-1b73448b696e req-e38f7bca-e4bc-4f06-a338-80e7f946b1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c6bdb0-09d8-496b-998a-c2a4252c5772", "name": "network-vif-plugged", "status": "completed", "tag": "88802b38-9718-44af-a9c0-e377da1fdee6"}, {"server_uuid": "7bd22d66-6c09-4099-8205-5eec0effaeb6", "name": "network-vif-plugged", "status": "completed", "tag": "9a1f5b7e-89bf-488e-990f-34a0baf9914f"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:51.399673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-ec80531d-cca8-48cf-b0fd-1b73448b696e req-e38f7bca-e4bc-4f06-a338-80e7f946b1f5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.400136 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-ec80531d-cca8-48cf-b0fd-1b73448b696e req-e38f7bca-e4bc-4f06-a338-80e7f946b1f5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.418297 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-ec80531d-cca8-48cf-b0fd-1b73448b696e req-e38f7bca-e4bc-4f06-a338-80e7f946b1f5 service nova] Creating event network-vif-plugged:88802b38-9718-44af-a9c0-e377da1fdee6 for instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 on hv-cinder-84330 Jun 23 11:02:51.419017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-ec80531d-cca8-48cf-b0fd-1b73448b696e req-e38f7bca-e4bc-4f06-a338-80e7f946b1f5 service nova] Creating event network-vif-plugged:9a1f5b7e-89bf-488e-990f-34a0baf9914f for instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 on hv-cinder-84330 Jun 23 11:02:51.431235 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-ec80531d-cca8-48cf-b0fd-1b73448b696e req-e38f7bca-e4bc-4f06-a338-80e7f946b1f5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052430 Jun 23 11:02:51.432941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 53/99] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:51.578946 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:51.592379 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68e19dac-3a0c-44a2-bad2-4678b9e7e7c6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.297737 Jun 23 11:02:51.604353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 47/100] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:51 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:51.770694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:51.771447 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:51.780138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.780870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:51.781648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:51.801988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.065912 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:52.077456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c3e5efa5-0b38-43e0-8cc9-e0514e5bdf09 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1315 microversion: 2.1 time: 0.308912 Jun 23 11:02:52.078597 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 54/101] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:51 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:52.309169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:52.309867 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:52.321774 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.326147 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.328193 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.328783 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.373325 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:52.374034 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:52.385014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.387158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.391113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.393800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.743557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:52.752756 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0b2eb877-849b-4b18-ba80-cf6b3269acd5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.383434 Jun 23 11:02:52.761067 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 55/102] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:52 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:52.776470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:52.777363 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:52.789291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.789747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.792036 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.793910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.836197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:52.844411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33bb33a2-54f5-4ab3-a243-472d47124355 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1557 microversion: 2.1 time: 0.539176 Jun 23 11:02:52.849433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 48/103] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:52 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1557 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:52.869902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:52.873183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:52.885221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.887609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:52.890115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:52.890984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:53.009162 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:53.020787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9f0e0a49-5dd4-40a9-91dc-a912f1c3130d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.257705 Jun 23 11:02:53.021466 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 56/104] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:52 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:53.096882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:53.098346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:53.108712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.109306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:53.109684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d3294f5d-3fa1-4b18-ad6d-b6d50c96f709 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247019 Jun 23 11:02:53.110403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.110982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:53.111094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 49/105] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:02:52 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-interface => generated 285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:53.473278 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:53.480943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7a9c5144-8079-41c3-8e93-ad8a64a2f407 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1501 microversion: 2.1 time: 0.387748 Jun 23 11:02:53.481519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 57/106] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:53 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1501 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:53.775840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:53.777298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:53.786152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.787157 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:53.788483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:53.791408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:54.039906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:54.040590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:54.052185 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:54.052645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:54.057440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:54.058049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:54.211760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:54.224327 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-393ec6fe-56bf-4f8a-a1fd-ae6566793586 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.457968 Jun 23 11:02:54.225994 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 50/107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:53 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:54.230707 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-38c414a7-2183-4d5f-9e84-f08ea7aa1678 req-7796ddc6-229d-4ee2-b65a-b72601fd3171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d", "name": "network-vif-plugged", "status": "completed", "tag": "f38d95a7-ab3e-47d6-991b-c6ccc781d5fe"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:54.243829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-38c414a7-2183-4d5f-9e84-f08ea7aa1678 req-7796ddc6-229d-4ee2-b65a-b72601fd3171 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:54.244514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-38c414a7-2183-4d5f-9e84-f08ea7aa1678 req-7796ddc6-229d-4ee2-b65a-b72601fd3171 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:54.262990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-38c414a7-2183-4d5f-9e84-f08ea7aa1678 req-7796ddc6-229d-4ee2-b65a-b72601fd3171 service nova] Creating event network-vif-plugged:f38d95a7-ab3e-47d6-991b-c6ccc781d5fe for instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d on hv-cinder-84330 Jun 23 11:02:54.270782 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-38c414a7-2183-4d5f-9e84-f08ea7aa1678 req-7796ddc6-229d-4ee2-b65a-b72601fd3171 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043396 Jun 23 11:02:54.272310 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 51/108] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:54.654538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:54.662579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-947cb318-10bc-49b8-97f6-e26717099935 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.628052 Jun 23 11:02:54.663818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 58/109] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:54 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:55.139138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae990926-029f-4531-aacd-125b85a796c8"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:55.141937 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:55.152427 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.153445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.155259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.156013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.249737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:55.250372 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:55.289430 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.290085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.292039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.292482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.750260 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:55.764952 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-681b556f-9e6a-48fb-ae95-7f68954fdd60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1322 microversion: 2.1 time: 0.523146 Jun 23 11:02:55.776087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 59/110] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:55 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:55.783551 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:55.784591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:55.807115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.808654 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:55.810984 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:55.811716 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:56.050785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:56.071522 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4bee2b14-d9b4-4372-93c8-619b5fba1122 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.289168 Jun 23 11:02:56.072222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 60/111] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:55 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:56.081053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-2a29feac-84fc-4670-be68-69874e1ad1b6 req-883c93cb-adef-481d-bd08-1edc3ec61f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2946bfb4-cd02-4237-8291-ad974a96ded6", "tag": "7c27c36f-56fd-4d7b-b077-2903298e9c9c"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:56.097650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-2a29feac-84fc-4670-be68-69874e1ad1b6 req-883c93cb-adef-481d-bd08-1edc3ec61f74 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.098375 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-2a29feac-84fc-4670-be68-69874e1ad1b6 req-883c93cb-adef-481d-bd08-1edc3ec61f74 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:56.130066 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-2a29feac-84fc-4670-be68-69874e1ad1b6 req-883c93cb-adef-481d-bd08-1edc3ec61f74 service nova] Creating event network-changed:7c27c36f-56fd-4d7b-b077-2903298e9c9c for instance 2946bfb4-cd02-4237-8291-ad974a96ded6 on hv-cinder-84330 Jun 23 11:02:56.142347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-2a29feac-84fc-4670-be68-69874e1ad1b6 req-883c93cb-adef-481d-bd08-1edc3ec61f74 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068695 Jun 23 11:02:56.142976 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 61/112] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:56.782761 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:56.783449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:56.793356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.793816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:56.794590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:56.795035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.009848 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:57.019411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f15fe903-6391-491f-8396-097e68f68aea tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1516 microversion: 2.1 time: 0.240825 Jun 23 11:02:57.020399 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 62/113] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:56 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1516 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:57.038439 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:57.039827 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:57.046143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:57.046880 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.047566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:57.048176 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.139912 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:57.152531 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-847ae374-8a09-40c9-aa0a-29807fbc6a67 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "POST /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.021357 Jun 23 11:02:57.157955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 52/114] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:02:55 2022] POST /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4/os-volume_attachments => generated 194 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:57.161452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:57.162147 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:57.164576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lazy-loading 'flavor' on Instance uuid 7bd22d66-6c09-4099-8205-5eec0effaeb6 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:02:57.183444 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:57.184183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.186378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:57.195767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.393119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d90032f5-5a5c-48a8-89b3-0e1e78e8789c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6/action" status: 200 len: 32 microversion: 2.1 time: 0.359984 Jun 23 11:02:57.394033 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 63/115] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:02:57 2022] POST /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:02:57.405063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:57.405772 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:57.406706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:57.412572 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:57.413610 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.414550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:57.414819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:57.414984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-86d151fa-5125-4fe7-9237-bb6bba612f19 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1363 microversion: 2.1 time: 0.260246 Jun 23 11:02:57.415753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 53/116] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:57 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:57.577101 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:57.585538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a562cacd-fb38-4483-9ea9-3e352f0a82a4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.185888 Jun 23 11:02:57.587001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 64/117] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:57 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:58.219334 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1303405533", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "networks": [{"uuid": "90335769-5abc-4a45-87f8-aca0c9113916"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:02:58.274706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] validate_networks() for [('90335769-5abc-4a45-87f8-aca0c9113916', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:02:58.443719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:58.444899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:58.451526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.452291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.453054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.453652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.642976 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:58.655734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f8bc110f-bf91-4660-a828-051c84337879 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1549 microversion: 2.1 time: 0.226855 Jun 23 11:02:58.657612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 65/118] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:58 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:58.666657 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:58.668094 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:58.680983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.682081 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.684241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.685346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.755158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:02:58.755873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:02:58.757068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:02:58.757611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:02:58.758163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:02:58.770195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.771212 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.773063 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.773857 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.804346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Getting quotas for project 64682ed401c74af7aa436a2171819ebe. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:02:58.809112 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Getting quotas for user 1b0423a12e39453e9cd6d1e8ab43af60 and project 64682ed401c74af7aa436a2171819ebe. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:02:58.821808 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:02:58.824135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:02:58.858676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:58.870867 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7e15be23-6c07-4a48-b61b-2f71115fc0ef tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.210965 Jun 23 11:02:58.882960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81933893-3284-4eac-8de5-0325cb1e5ac3 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665372 Jun 23 11:02:58.882960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 54/119] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:02:58.884142 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 66/120] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:58 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:02:58.893225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:58.893910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:58.895366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7ac08a63-5345-40ca-a638-ecc6fdaf1ce1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:58.896828 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7ac08a63-5345-40ca-a638-ecc6fdaf1ce1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:58.902210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.902872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:58.903873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:58.904463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:59.006349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7ac08a63-5345-40ca-a638-ecc6fdaf1ce1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:02:59.017558 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7ac08a63-5345-40ca-a638-ecc6fdaf1ce1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1219 microversion: 2.1 time: 0.128786 Jun 23 11:02:59.018453 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 67/121] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:58 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:02:59.110750 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d949b47-e170-4a70-b146-83e89f3ed104 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.221927 Jun 23 11:02:59.111539 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 55/122] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:02:58 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:02:59.889951 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:02:59.890565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:02:59.896563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:59.897564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:02:59.898715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:02:59.899376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:00.036953 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:00.044707 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:00.053629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:00.054184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:00.055167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:00.055610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:00.116002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:00.134564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-236936d2-1f38-49f0-9d1c-46a7726a826d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.248234 Jun 23 11:03:00.147013 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 68/123] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:02:59 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:00.285979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:00.322011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-448cc1c8-05c5-4aec-8c26-c4821b3d7be7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1271 microversion: 2.1 time: 0.291457 Jun 23 11:03:00.323119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 56/124] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:00 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:01.152654 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:01.153262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:01.163528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:01.165769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:01.166594 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:01.167043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:01.246191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-4adb4e34-7a08-45b1-bf1b-4d60c80b58a5 req-cd03ed46-8074-4970-baff-acc525ee202b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d", "tag": "f38d95a7-ab3e-47d6-991b-c6ccc781d5fe"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:01.255166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4adb4e34-7a08-45b1-bf1b-4d60c80b58a5 req-cd03ed46-8074-4970-baff-acc525ee202b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:01.255885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4adb4e34-7a08-45b1-bf1b-4d60c80b58a5 req-cd03ed46-8074-4970-baff-acc525ee202b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:01.267296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-4adb4e34-7a08-45b1-bf1b-4d60c80b58a5 req-cd03ed46-8074-4970-baff-acc525ee202b service nova] Creating event network-changed:f38d95a7-ab3e-47d6-991b-c6ccc781d5fe for instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d on hv-cinder-84330 Jun 23 11:03:01.273496 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-4adb4e34-7a08-45b1-bf1b-4d60c80b58a5 req-cd03ed46-8074-4970-baff-acc525ee202b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030903 Jun 23 11:03:01.274840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 57/125] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:03:01.340611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:01.341318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:01.359747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:01.360194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:01.361174 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:01.361763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:01.563866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:01.579707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-edde092e-cdf3-430b-a5b6-2f6a0f82bf7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.426681 Jun 23 11:03:01.579707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 69/126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:01 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:01.899226 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:01.907986 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-53120bac-da9c-4ac2-8ebc-9f167d7d17c7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1277 microversion: 2.1 time: 0.572316 Jun 23 11:03:01.910917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 58/127] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:01 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1277 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:02.594915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:02.595521 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:02.603252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:02.603959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:02.604910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:02.605352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:02.887118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:02.899507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-752ea6a3-a8f7-41e8-8bea-725334af9c24 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.305276 Jun 23 11:03:02.904468 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 70/128] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:02 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:02.926513 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:02.927378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:02.934069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:02.935130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:02.936148 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:02.936833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.105644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:03.117800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-77ffb38a-bffd-4d00-b06c-3a4bca5ba849 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.195017 Jun 23 11:03:03.118631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 59/129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:02 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:03.246563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-cebf4b80-06a1-4443-8f5d-e5a70642d01d req-21281429-4e25-4a84-a129-3cb19f489b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e278233-9622-48db-ad2b-5431be7483f2", "tag": "a0add7ed-5464-4c4c-bb48-b733b2757101"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:03.271940 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-cebf4b80-06a1-4443-8f5d-e5a70642d01d req-21281429-4e25-4a84-a129-3cb19f489b91 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.273063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-cebf4b80-06a1-4443-8f5d-e5a70642d01d req-21281429-4e25-4a84-a129-3cb19f489b91 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.289538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-cebf4b80-06a1-4443-8f5d-e5a70642d01d req-21281429-4e25-4a84-a129-3cb19f489b91 service nova] Creating event network-changed:a0add7ed-5464-4c4c-bb48-b733b2757101 for instance 2e278233-9622-48db-ad2b-5431be7483f2 on hv-cinder-84330 Jun 23 11:03:03.294377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-cebf4b80-06a1-4443-8f5d-e5a70642d01d req-21281429-4e25-4a84-a129-3cb19f489b91 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056959 Jun 23 11:03:03.295173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 71/130] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:03.530945 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1643946889", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "networks": [{"uuid": "97c23ceb-2864-4713-821e-e19a5b81f5fe"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:03.585868 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] validate_networks() for [('97c23ceb-2864-4713-821e-e19a5b81f5fe', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:03:03.915669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:03.917113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:03.923730 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.924180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:03.924937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:03.925535 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:04.076953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:04.099981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f243520e-700c-4285-9344-0e939a5f6c7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.174587 Jun 23 11:03:04.101214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 72/131] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:03 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:04.120706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:03:04.121689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:03:04.122729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:03:04.123171 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:03:04.123897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:03:04.138173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:04.138893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:04.147870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:04.148312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:04.149097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:04.149531 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:04.154229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:04.154669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:04.155423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:04.155880 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:04.176056 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Getting quotas for project 1da9afa4daa046239d16a594150a994c. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:04.180955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Getting quotas for user 17071129652c4fa09b3b4b20c0dc0725 and project 1da9afa4daa046239d16a594150a994c. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:04.194941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:03:04.197503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:03:04.254125 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-324cfdf0-6968-4beb-a82a-a57b5456f724 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727011 Jun 23 11:03:04.260590 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 60/132] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:03:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:03:04.270467 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-48a174c8-7dd7-4f92-8dd2-522677278cd9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:04.271092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-48a174c8-7dd7-4f92-8dd2-522677278cd9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:04.336199 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-48a174c8-7dd7-4f92-8dd2-522677278cd9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:04.356442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-48a174c8-7dd7-4f92-8dd2-522677278cd9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1214 microversion: 2.1 time: 0.093917 Jun 23 11:03:04.366499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 61/133] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:04 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:04.366763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:04.369771 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ad5bdc6f-2298-48e0-b7d3-24dd113ef910 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.235695 Jun 23 11:03:04.371775 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 73/134] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:04 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:05.118202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:05.118808 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:05.125577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.126147 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.126770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.127197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.252003 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:05.259942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02f7e1db-0825-45c9-ae66-71b28cfd36ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.145526 Jun 23 11:03:05.260509 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 62/135] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:05 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:05.374241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:05.374832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:05.377924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:05.381968 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.382413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.383219 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.383604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.388312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:05.389012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:05.395419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.395975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.396808 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:05.397878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:05.473430 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:05.482024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7071c5e2-d078-4ff6-9b6c-954934426868 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1218 microversion: 2.1 time: 0.111836 Jun 23 11:03:05.483129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 74/136] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:05 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:05.558991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:05.568097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-652c365e-28ed-4175-84a8-b8fff24c6f49 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.184390 Jun 23 11:03:05.569611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 63/137] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:05 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:06.276575 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:06.277107 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:06.284230 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.284680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.285463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.285897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.420834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:06.428240 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-adfc5f02-c504-4d7e-8b6e-778df2f6fa6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.155602 Jun 23 11:03:06.428787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 75/138] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:06 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:06.498533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:06.499227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:06.505547 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.505992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.506744 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.507172 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.567073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:06.574259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6b5fdca1-c6d9-458e-be60-2fe17cc2d1a5 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1210 microversion: 2.1 time: 0.079804 Jun 23 11:03:06.574806 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 64/139] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:06 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:06.585874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:06.586479 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:06.592508 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.592954 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.593718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:06.594151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:06.724609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:06.732121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-906d3858-b911-4c83-a3fa-3bd36b07d76b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.150518 Jun 23 11:03:06.732676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 76/140] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:06 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:07.445364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:07.445972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:07.449016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:07.452638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.453085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.454018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.454457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.586986 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:07.590210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:07.590618 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:07.590819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:07.596936 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.597369 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.597491 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81bc6701-7618-46ae-8467-d08a4312463f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.155878 Jun 23 11:03:07.598126 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.598557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.604045 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 65/141] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:07 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:07.664601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:07.672641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7cc4aee4-b6d4-46a0-8bc1-97cadf4c0d4b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1210 microversion: 2.1 time: 0.086164 Jun 23 11:03:07.680110 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 77/142] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:07 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:07.749045 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:07.749617 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:07.756874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.757317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.758124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:07.758563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:07.888080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:07.895388 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96c5bdfa-4b8c-4925-90b1-9f5ff4d1625e tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.150629 Jun 23 11:03:07.895976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 66/143] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:07 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:08.544889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-c3bcbbb7-6e84-4f93-856e-86eab1f822e9 req-01779497-ac22-42c6-921d-5c2363020a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e278233-9622-48db-ad2b-5431be7483f2", "name": "network-vif-plugged", "status": "completed", "tag": "a0add7ed-5464-4c4c-bb48-b733b2757101"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:08.553057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-c3bcbbb7-6e84-4f93-856e-86eab1f822e9 req-01779497-ac22-42c6-921d-5c2363020a12 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.554021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-c3bcbbb7-6e84-4f93-856e-86eab1f822e9 req-01779497-ac22-42c6-921d-5c2363020a12 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.565736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-c3bcbbb7-6e84-4f93-856e-86eab1f822e9 req-01779497-ac22-42c6-921d-5c2363020a12 service nova] Creating event network-vif-plugged:a0add7ed-5464-4c4c-bb48-b733b2757101 for instance 2e278233-9622-48db-ad2b-5431be7483f2 on hv-cinder-84330 Jun 23 11:03:08.571290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-c3bcbbb7-6e84-4f93-856e-86eab1f822e9 req-01779497-ac22-42c6-921d-5c2363020a12 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030142 Jun 23 11:03:08.571918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 78/144] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:08.614363 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:08.615046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:08.622618 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.623132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.623998 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.624508 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.690359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:08.691021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:08.697904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.698354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.699112 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.699729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.766987 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:08.772288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:08.775251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a0c7ecb1-df2b-4064-88da-a275b675e18d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1266 microversion: 2.1 time: 0.089211 Jun 23 11:03:08.775937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 79/145] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:08 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:08.782194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b0be7c18-ed73-4098-9c4c-622fbe803f3b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.171821 Jun 23 11:03:08.782765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 67/146] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:08 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:08.912392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:08.913638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:08.919872 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.920326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.921092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:08.921525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:08.941515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:09.017874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:09.114599 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:09.121977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-313439f7-9555-446d-b87a-451708ba340b tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.213422 Jun 23 11:03:09.122801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 80/147] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:08 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:09.792632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:09.793233 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:09.800224 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.800604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.801362 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.801808 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.802544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:09.803155 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:09.810287 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.810734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.811717 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:09.812151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:09.881840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:09.889197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff163724-3f6d-4bbf-9594-429c1e42ee3b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1272 microversion: 2.1 time: 0.100340 Jun 23 11:03:09.889763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 68/148] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:09 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:09.946840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:09.954895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-074589e0-0146-4cdf-9be9-1f8d483f426a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.156701 Jun 23 11:03:09.955552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 81/149] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:09 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:10.138552 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:10.139406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:10.145531 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.145941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.147517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.148131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.179719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:10.180269 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:10.191874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.192232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.192999 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.193426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.230935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:03:10.351575 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8abb4f2c-fdb8-4527-b6d4-bbfe01dc1018 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 204 len: 0 microversion: 2.1 time: 0.174538 Jun 23 11:03:10.353286 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 82/150] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:03:10 2022] DELETE /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:03:10.361438 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:10.362470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:10.371512 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.373449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.374805 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.375341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.540248 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:10.552982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e0b09916-2916-4c6f-87a1-9d1a620557e0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.196086 Jun 23 11:03:10.553893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 83/151] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:10 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:10.594488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:10.603353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-520a838c-9a4f-4df5-a7c4-1bd451d7aae0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.468867 Jun 23 11:03:10.603970 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 69/152] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:10 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:10.907211 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:10.908350 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:10.914317 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.914760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.915528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.915990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.972475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:10.973079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:10.984012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.984447 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:10.985219 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:10.985674 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:11.056178 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:11.064190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-362afbd4-b7c0-4bdc-8f30-a0a6f9fd1f06 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.161286 Jun 23 11:03:11.064958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 84/153] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:10 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:11.134763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:11.143328 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11d44a94-db70-4555-a1e7-6b387967df34 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.174728 Jun 23 11:03:11.144317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 70/154] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:10 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:11.570181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:11.570786 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:11.577395 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:11.577847 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:11.578694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:11.579125 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:11.620021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:11.620517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:11.626752 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:11.627184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:11.627986 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:11.628528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:11.722504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:11.731726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e9c7eeed-eb11-417b-b750-54220134ab10 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.165220 Jun 23 11:03:11.732694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 85/155] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:11 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:11.775933 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:11.783361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c367e0a-8c5f-4032-975a-963110ba2bcc tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.167331 Jun 23 11:03:11.784306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 71/156] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:11 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:12.082073 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:12.082681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:12.089481 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.089937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.090705 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.091137 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.161248 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:12.161963 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:12.170192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.170632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.171385 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.171841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.240069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:12.248085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ec52cbf3-60a2-4fcb-92d1-ea82a078677b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.169853 Jun 23 11:03:12.249256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 86/157] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:12 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:12.320765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:12.328995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8fea4a63-7a7e-4d04-997b-d9d0dc746c19 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.171958 Jun 23 11:03:12.329560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 72/158] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:12 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:12.748516 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:12.749118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:12.755038 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.755482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.756271 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.756764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.805311 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:12.806155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:12.813125 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.813689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.814654 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:12.815321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:12.899476 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:12.907555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-da00cefa-1069-4472-a522-a44d80727d5b tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.163010 Jun 23 11:03:12.908144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 87/159] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:12 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:12.951068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:12.958466 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef1c4db5-2287-48b4-8021-b3aae41a7584 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.158745 Jun 23 11:03:12.959016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 73/160] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:12 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:13.265982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:13.266544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:13.273663 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.274105 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.274867 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.275297 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.346101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:13.346705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:13.354324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.354979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.355769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.356205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.422196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:13.430795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8db77581-dce0-41ec-907d-a859f20875a2 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.169001 Jun 23 11:03:13.431496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 88/161] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:13 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:13.495990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:13.504046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7330f1ca-e233-4a66-87a6-173a69ccedc3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.161886 Jun 23 11:03:13.504611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 74/162] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:13 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:13.924962 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:13.925773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:13.943696 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.944866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.951970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.953489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.975083 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:13.975726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:13.991594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.992356 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:13.993131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:13.993759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.108130 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:14.118449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e262dbc9-d69c-46e1-a0f2-25aa6faa0bb3 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.197140 Jun 23 11:03:14.119118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 89/163] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:13 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:14.167959 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:14.238667 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:14.246765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-02209fe5-2b17-453f-ae06-b625ccb4365d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1319 microversion: 2.1 time: 0.275723 Jun 23 11:03:14.247572 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 75/164] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:13 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:14.449154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:14.449938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:14.456524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.456974 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.457769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.458202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.521503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:14.522131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:14.525840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=14 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:14.530307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.531019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.531940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.532374 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.602103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:14.609892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-da9b629e-521d-40f2-ba65-0f14ec05f034 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.165220 Jun 23 11:03:14.610453 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 90/165] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:14 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:14.711335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-7b785f44-a4a0-4a67-bed9-d374f8c1a227 req-7731e605-39a5-4b39-84fc-844fdc39913b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d33040-550a-41b4-8a1e-3c4c12dac3f4", "tag": "e2791f05-4320-4a12-805d-2a7b21ddd3ca"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:14.719222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-7b785f44-a4a0-4a67-bed9-d374f8c1a227 req-7731e605-39a5-4b39-84fc-844fdc39913b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:14.719675 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-7b785f44-a4a0-4a67-bed9-d374f8c1a227 req-7731e605-39a5-4b39-84fc-844fdc39913b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:14.732193 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-7b785f44-a4a0-4a67-bed9-d374f8c1a227 req-7731e605-39a5-4b39-84fc-844fdc39913b service nova] Creating event network-changed:e2791f05-4320-4a12-805d-2a7b21ddd3ca for instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 on hv-cinder-84330 Jun 23 11:03:14.737826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-7b785f44-a4a0-4a67-bed9-d374f8c1a227 req-7731e605-39a5-4b39-84fc-844fdc39913b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030735 Jun 23 11:03:14.738473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 91/166] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:03:14.761728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:14.769150 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d78a40bd-f38e-48c7-8e04-a3699cdc978a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.252116 Jun 23 11:03:14.769796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 76/167] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:14 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:15.137122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:15.137799 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:15.143884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.144325 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.145072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.145497 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.263146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:15.263892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:15.269902 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:15.270042 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.270352 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.271132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.271585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.278682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2dabf671-0510-4d1c-94a9-d337c51e6ba2 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.145765 Jun 23 11:03:15.279244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 92/168] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:15 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:15.399597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:15.407396 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-06e6448c-1d1a-4943-9d2f-d7df853c2621 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1507 microversion: 2.1 time: 0.148137 Jun 23 11:03:15.407989 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 77/169] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:15 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:15.626325 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:15.626934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:15.633636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.634092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.634856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.635296 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.769317 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:15.777812 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-00c57a02-6bc9-47a0-bce7-6ae0a482e5ed tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.155480 Jun 23 11:03:15.778445 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 93/170] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:15 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:15.793156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:15.793756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:15.801979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.802495 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.804081 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:15.804586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:15.933756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:15.941243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c85c310-39a5-4545-8380-421d4632737c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.151904 Jun 23 11:03:15.941800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 78/171] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:15 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:16.295494 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:16.296133 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:16.302295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:16.302740 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:16.304037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:16.304470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:16.458175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:16.467116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d7eccda3-5634-4b0c-b575-3fd9cc7976f9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.175396 Jun 23 11:03:16.467763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 94/172] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:16 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:16.795858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:16.796449 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:16.802852 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:16.803886 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:16.804655 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:16.805086 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:16.938330 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:16.946902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-958cacf8-b1ce-47a4-a6f4-16187a9b36dc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.155027 Jun 23 11:03:16.947465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 79/173] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:16 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:16.959147 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:16.960317 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:16.966492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:16.966931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:16.967720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:16.968152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:17.096459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:17.104604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0f6a09d5-fe53-445e-ae26-79c807b9eef9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.150055 Jun 23 11:03:17.105375 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 95/174] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:16 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:17.484700 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:17.485242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:17.491207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:17.491646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:17.492586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:17.493194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:17.624051 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:17.632628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-47a6930b-f910-4d87-ae7c-7376e8db4c36 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.151765 Jun 23 11:03:17.633194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 80/175] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:17 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:17.964758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:17.965356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:17.971460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:17.972029 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:17.972860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:17.973311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:17.979388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:18.111960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:18.119939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-984fda23-cf17-44a0-8522-6f5bf4a32a0d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.159002 Jun 23 11:03:18.120491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 96/176] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:17 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:18.123156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:18.123799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:18.132579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:18.133021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:18.133778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:18.134207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:18.269242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:18.276743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-625838e0-8906-40d0-9835-73aebb371ddf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.157726 Jun 23 11:03:18.277311 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 81/177] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:18 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:18.506398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-1bb0a08e-765a-46c3-8ad0-bad217b404e7 req-afa2737c-f133-4843-8838-47de0e5119f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e40b529-165d-4f7f-8768-5f2ed22815b4", "name": "network-vif-unplugged", "status": "completed", "tag": "bf647141-29b7-47c1-a7c3-6e9e399350c6"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:18.515202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-1bb0a08e-765a-46c3-8ad0-bad217b404e7 req-afa2737c-f133-4843-8838-47de0e5119f1 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:18.515950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-1bb0a08e-765a-46c3-8ad0-bad217b404e7 req-afa2737c-f133-4843-8838-47de0e5119f1 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:18.528861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-1bb0a08e-765a-46c3-8ad0-bad217b404e7 req-afa2737c-f133-4843-8838-47de0e5119f1 service nova] Creating event network-vif-unplugged:bf647141-29b7-47c1-a7c3-6e9e399350c6 for instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 on hv-cinder-84330 Jun 23 11:03:18.533626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-1bb0a08e-765a-46c3-8ad0-bad217b404e7 req-afa2737c-f133-4843-8838-47de0e5119f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031691 Jun 23 11:03:18.534208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 97/178] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:18.650542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:18.651070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:18.657200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:18.657648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:18.658414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:18.658848 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:18.676926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:18.788792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:18.796792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c7371b2-bf42-4704-a99f-a7d5666f02d0 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.151361 Jun 23 11:03:18.797442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 82/179] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:18 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:19.138006 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:19.138691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:19.144932 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.145372 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.146123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.146553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.275121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:19.282585 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ae4c450c-c185-41b4-8af7-a93e382f41a8 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.148844 Jun 23 11:03:19.283140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 98/180] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:19 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:19.293178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:19.293790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:19.300523 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.300969 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.301931 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.302371 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.432849 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:19.440284 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c324f26-7761-4473-a9c2-5daef47ccfb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.150958 Jun 23 11:03:19.440837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 83/181] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:19 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:19.813345 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:19.813972 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:19.820054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.820496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.821249 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:19.821681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:19.952298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:19.960887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-af3b1848-3002-4739-a61c-2f27c22c4cf8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.151402 Jun 23 11:03:19.961450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 99/182] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:19 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:20.300640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:20.301193 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:20.307785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.308228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.308980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.309407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.439310 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:20.447396 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-012e73a5-fe63-4b09-9341-de03d8505f5b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.150668 Jun 23 11:03:20.448000 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 84/183] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:20 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:20.457927 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:20.458533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:20.465256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.465693 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.466439 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.466873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.593982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:20.602277 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b67d5dc1-33b8-4824-8ae0-fe53c9dcbb08 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.148021 Jun 23 11:03:20.602856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 100/184] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:20 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:20.977973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:20.978570 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:20.984585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.985023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:20.985776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:20.986185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.119290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:21.128154 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0c7c5d75-b329-47e8-a857-6691468c73f1 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.154711 Jun 23 11:03:21.128717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 85/185] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:20 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:21.464419 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:21.464926 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:21.470965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.471409 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.472205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.472642 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.599923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:21.607897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4f12b943-bbf1-463c-968e-00a5f555e2c9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.147354 Jun 23 11:03:21.608454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 101/186] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:21 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:21.618123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:21.618763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:21.625857 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.626296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.627059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:21.627516 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:21.758364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:21.765785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0139513a-82ae-4047-9096-4ce3b2ef6e7a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.151447 Jun 23 11:03:21.766342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 86/187] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:21 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:22.144959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:22.145557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:22.151461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.151929 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.152677 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.153104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.284517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:22.292326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7dcabcaf-02ed-485d-817c-389e2c8de48e tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.151112 Jun 23 11:03:22.292881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 102/188] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:22 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:22.625115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:22.625746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:22.632253 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.632694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.633447 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.633882 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.760946 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:22.768330 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-afa37e2d-c11c-4219-96b2-399c17997a7c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.147440 Jun 23 11:03:22.768891 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 87/189] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:22 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:22.781995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:22.782601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:22.789157 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.789589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.790364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:22.790811 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:22.919334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:22.926813 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7d3a8dda-5959-423a-98cf-1f9f50d1f760 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.148576 Jun 23 11:03:22.927373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 103/190] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:22 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:23.309505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:23.310107 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:23.316136 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.316583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.317336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.317796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.446317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:23.454287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-07a2b767-a7c8-43b7-b88c-980245f2ff0f tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1553 microversion: 2.1 time: 0.148647 Jun 23 11:03:23.454845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 88/191] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:23 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:23.786261 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:23.786916 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:23.793309 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.793752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.794517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.795018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.928844 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:23.936890 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b2b7cf69-c977-4914-8552-5a4d43d6ade9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.155138 Jun 23 11:03:23.938713 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 104/192] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:23 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:23.944282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:23.945346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:23.953691 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.954231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:23.955069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:23.955593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.202575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:24.210009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5bf8450c-3f6c-48eb-a644-289f4b956012 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.269758 Jun 23 11:03:24.210584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 89/193] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:23 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:24.471861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:24.472582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:24.480241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.480693 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.481464 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.481899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.569680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:24.581259 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3382e2d0-a980-4a84-9a1a-ab8a348a9372 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1511 microversion: 2.1 time: 0.113057 Jun 23 11:03:24.582149 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 105/194] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:24 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:24.640927 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-13c6a17f-ecf9-4bf8-b64f-7477ca6176f0 req-3159181b-e788-490d-b604-bdd59f57f35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e40b529-165d-4f7f-8768-5f2ed22815b4", "name": "network-vif-deleted", "tag": "bf647141-29b7-47c1-a7c3-6e9e399350c6"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:24.650160 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-13c6a17f-ecf9-4bf8-b64f-7477ca6176f0 req-3159181b-e788-490d-b604-bdd59f57f35b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.650606 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-13c6a17f-ecf9-4bf8-b64f-7477ca6176f0 req-3159181b-e788-490d-b604-bdd59f57f35b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.662274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-13c6a17f-ecf9-4bf8-b64f-7477ca6176f0 req-3159181b-e788-490d-b604-bdd59f57f35b service nova] Creating event network-vif-deleted:bf647141-29b7-47c1-a7c3-6e9e399350c6 for instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 on hv-cinder-84330 Jun 23 11:03:24.668210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-13c6a17f-ecf9-4bf8-b64f-7477ca6176f0 req-3159181b-e788-490d-b604-bdd59f57f35b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 Jun 23 11:03:24.668814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 90/195] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:24.955045 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:24.955559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:24.961675 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.962124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:24.962894 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:24.963334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.096865 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:25.104984 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bb318065-9a4d-481c-907a-9f85feef9f8e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.154313 Jun 23 11:03:25.105541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 106/196] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:24 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:25.227903 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:25.228591 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:25.235342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.235809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.236575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.237006 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.379161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:25.386613 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b32b7362-2b6b-48ee-89a7-cbb7195f7ecb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.164041 Jun 23 11:03:25.387163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 91/197] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:25 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:25.599437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:25.600178 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:25.606591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.607039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.607840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:25.608273 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:25.668671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:25.677143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-05a2ceaa-8d88-4412-9808-6de46ae476a8 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1511 microversion: 2.1 time: 0.081495 Jun 23 11:03:25.677909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 107/198] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:25 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1511 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:26.122435 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:26.123291 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:26.129341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.129780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.130530 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.130953 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.263594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:26.271985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9934137a-5eab-4a96-a467-16b9e0547d61 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.153321 Jun 23 11:03:26.272543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 92/199] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:26 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:26.411454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:26.412092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:26.418820 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.419273 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.420086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.420511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.632252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:26.640352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f564c17e-3794-4c14-9d4b-a535a5e3c38a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.234814 Jun 23 11:03:26.641024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 108/200] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:26 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:26.694059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:26.694691 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:26.701190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.701638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.702400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.702829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.734156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:26.734502 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:26.735014 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lazy-loading 'fault' on Instance uuid 6e40b529-165d-4f7f-8768-5f2ed22815b4 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:03:26.779019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6390dc942db430e8dd648901900432b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c6487f3e094808b1665bdd93da9b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:26.786853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8673310a-2d4f-4044-8082-886881373a7a tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 200 len: 1351 microversion: 2.1 time: 0.096653 Jun 23 11:03:26.787411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 93/201] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:26 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:27.289084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:27.289722 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:27.295703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.296147 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.296915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.297340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.431340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:27.440120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b8c50895-76e8-4a3f-a5cd-74214ae53766 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.154452 Jun 23 11:03:27.440687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 109/202] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:27 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:27.657800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:27.658434 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:27.664888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.665331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.666078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.666506 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.796675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:27.804120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:27.804849 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:27.804955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e29f5bff-b3f4-4014-ab26-c844a362286a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.150957 Jun 23 11:03:27.805843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 94/203] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:27 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:27.811386 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.811873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.812655 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.813093 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.827082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] HTTP exception thrown: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Request method failure captured: Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 HTTP/1.1 Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgyAQU5yUeq1LKiO3OjLXtaH7zNeI4g5lwTPhxCcCHYWZs1-BXdcCX3mGsCId_A82EhPGfYSDbN5f2PHEVeCNpoEJhlBgYvjxh49nTo_QojROXzcG8ejXQlrHYyb2A4887kwKed6c3UwnKPxZRQL-ZK9nWTdbgmjysWnXGos-sCi_U Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:03:27.831797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c6c6487f3e094808b1665bdd93da9b3c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: f6390dc942db430e8dd648901900432b Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '6e40b529-165d-4f7f-8768-5f2ed22815b4'} Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:27.834078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.835611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.837529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Returning 404 to user: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:27.837529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-386ebd94-9e9f-4ee9-9307-58868d12c5fc tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 404 len: 111 microversion: 2.1 time: 0.032948 Jun 23 11:03:27.837529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 110/204] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:27 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:03:27.939438 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:27.940451 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:27.946858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.947299 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.948096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:27.948527 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:27.960676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] HTTP exception thrown: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Request method failure captured: Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4/os-volume_attachments HTTP/1.1 Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgyAQU5yUeq1LKiO3OjLXtaH7zNeI4g5lwTPhxCcCHYWZs1-BXdcCX3mGsCId_A82EhPGfYSDbN5f2PHEVeCNpoEJhlBgYvjxh49nTo_QojROXzcG8ejXQlrHYyb2A4887kwKed6c3UwnKPxZRQL-ZK9nWTdbgmjysWnXGos-sCi_U Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:03:27.965275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c6c6487f3e094808b1665bdd93da9b3c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: f6390dc942db430e8dd648901900432b Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.966705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'server_id': '6e40b529-165d-4f7f-8768-5f2ed22815b4'} Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:27.967481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:27.968635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:27.969668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Returning 404 to user: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:27.969668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bea224e4-ed06-4163-8e2f-dbee9faf1b39 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031311 Jun 23 11:03:27.969668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 95/205] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:03:27 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:28.457735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:28.458352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:28.464405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:28.464851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:28.465634 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:28.466080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:28.609804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:28.619311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b9e63ae9-5d5e-4dc5-9752-116388f1da56 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.165611 Jun 23 11:03:28.619923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 111/206] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:28 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:28.642125 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-0ccee035-123d-4bd3-a948-e65abf2d409d req-f3a9d890-1759-403c-b7bd-8dac96bf3c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d33040-550a-41b4-8a1e-3c4c12dac3f4", "name": "network-vif-plugged", "status": "completed", "tag": "e2791f05-4320-4a12-805d-2a7b21ddd3ca"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:28.651242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0ccee035-123d-4bd3-a948-e65abf2d409d req-f3a9d890-1759-403c-b7bd-8dac96bf3c35 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:28.651716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-0ccee035-123d-4bd3-a948-e65abf2d409d req-f3a9d890-1759-403c-b7bd-8dac96bf3c35 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:28.665010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-0ccee035-123d-4bd3-a948-e65abf2d409d req-f3a9d890-1759-403c-b7bd-8dac96bf3c35 service nova] Creating event network-vif-plugged:e2791f05-4320-4a12-805d-2a7b21ddd3ca for instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 on hv-cinder-84330 Jun 23 11:03:28.670765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-0ccee035-123d-4bd3-a948-e65abf2d409d req-f3a9d890-1759-403c-b7bd-8dac96bf3c35 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032344 Jun 23 11:03:28.671495 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 96/207] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:28.823460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:28.824109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:28.834415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:28.834870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:28.835707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:28.836158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.022740 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:29.030350 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-994b92b0-9d59-465e-9c34-dd12991b357c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.211918 Jun 23 11:03:29.030914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 112/208] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:28 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:29.176703 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:29.177290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:29.188575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.189020 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.189789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.190224 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.204184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] HTTP exception thrown: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Request method failure captured: Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 HTTP/1.1 Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgyAQU5yUeq1LKiO3OjLXtaH7zNeI4g5lwTPhxCcCHYWZs1-BXdcCX3mGsCId_A82EhPGfYSDbN5f2PHEVeCNpoEJhlBgYvjxh49nTo_QojROXzcG8ejXQlrHYyb2A4887kwKed6c3UwnKPxZRQL-ZK9nWTdbgmjysWnXGos-sCi_U Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:03:29.206471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c6c6487f3e094808b1665bdd93da9b3c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: f6390dc942db430e8dd648901900432b Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.207947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '6e40b529-165d-4f7f-8768-5f2ed22815b4'} Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:29.208784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.210061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.212134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Returning 404 to user: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:29.212134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6c84b191-00c6-4a06-bef9-a071d2b602d5 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 404 len: 111 microversion: 2.1 time: 0.035553 Jun 23 11:03:29.212134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 97/209] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:03:29 2022] DELETE /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:29.218086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:29.218692 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] [instance: 6e40b529-165d-4f7f-8768-5f2ed22815b4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:29.224685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.225133 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.225892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.226338 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.239516 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] HTTP exception thrown: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Request method failure captured: Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 HTTP/1.1 Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgyAQU5yUeq1LKiO3OjLXtaH7zNeI4g5lwTPhxCcCHYWZs1-BXdcCX3mGsCId_A82EhPGfYSDbN5f2PHEVeCNpoEJhlBgYvjxh49nTo_QojROXzcG8ejXQlrHYyb2A4887kwKed6c3UwnKPxZRQL-ZK9nWTdbgmjysWnXGos-sCi_U Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:03:29.240990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c6c6487f3e094808b1665bdd93da9b3c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c6c6487f3e094808b1665bdd93da9b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: c6c6487f3e094808b1665bdd93da9b3c Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-DeleteServersTestJSON-1430548045 Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: f6390dc942db430e8dd648901900432b Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-DeleteServersTestJSON-1430548045-project Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.242340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '6e40b529-165d-4f7f-8768-5f2ed22815b4'} Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:29.243227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. Jun 23 11:03:29.244703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:29.246183 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] Returning 404 to user: Instance 6e40b529-165d-4f7f-8768-5f2ed22815b4 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:29.246183 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f4933663-3411-40ff-a1f2-ff8104c019e9 tempest-DeleteServersTestJSON-1430548045 tempest-DeleteServersTestJSON-1430548045-project] 10.222.0.65 "GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4" status: 404 len: 111 microversion: 2.1 time: 0.028085 Jun 23 11:03:29.246183 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 113/210] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:29 2022] GET /compute/v2.1/servers/6e40b529-165d-4f7f-8768-5f2ed22815b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:29.638035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:29.638790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:29.647584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.648080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.649092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:29.649528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:29.798138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:29.809869 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e69363a-96ac-460e-9823-3851678aa022 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.176835 Jun 23 11:03:29.814853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 98/211] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:29 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:30.046364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:30.046973 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:30.053536 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:30.053988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:30.055605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:30.056074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:30.312489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:30.321634 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:30.325138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f7b5af53-79fb-4272-83c4-e3e0588120e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.282699 Jun 23 11:03:30.337531 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 114/212] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:30 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:30.827167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:30.827721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:30.834128 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:30.834574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:30.835336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:30.835817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:30.977041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:30.984623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae3fe422-7d69-40ec-a91a-945f7c599e70 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1314 microversion: 2.1 time: 0.161342 Jun 23 11:03:30.985505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 99/213] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:30 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:31.342303 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:31.343512 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:31.350673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:31.351144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:31.351973 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:31.352407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:31.568312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:31.576550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2b410148-74b2-4562-be84-6e999df17f27 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.238036 Jun 23 11:03:31.577207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 115/214] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:31 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:32.001089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:32.001731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:32.012746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:32.013379 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:32.014247 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:32.014828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:32.235842 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:32.245175 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fb153de-7e48-461e-8755-be85fa053bc6 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1498 microversion: 2.1 time: 0.248514 Jun 23 11:03:32.245822 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 100/215] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:31 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1498 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:32.594190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:32.594797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:32.608520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:32.609119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:32.610431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:32.610878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:32.880180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:32.899166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-489cb73b-d268-4a01-8d1d-a2882ad8f67b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.308609 Jun 23 11:03:32.912580 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 116/216] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:32 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:33.918231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:33.918874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:33.925454 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:33.925902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:33.926728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:33.927167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:33.947973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:34.062094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:34.069605 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4585d1d1-6d77-44de-ab74-78084414cc48 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.155321 Jun 23 11:03:34.070155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 101/217] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:33 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:35.100087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:35.100758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:35.107619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:35.108131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:35.109157 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:35.109587 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:35.359100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:35.367010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-94878244-e473-442b-b1c0-6296f6ac7ea3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1522 microversion: 2.1 time: 0.284642 Jun 23 11:03:35.367980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 117/218] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:35 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:36.064459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:36.065571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:36.073403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.074104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.074940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.075791 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.141080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:03:36.324817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d13e37be-f106-4572-8725-b4429b0033f3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "DELETE /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 204 len: 0 microversion: 2.1 time: 0.263860 Jun 23 11:03:36.325979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 102/219] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:03:36 2022] DELETE /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:03:36.335637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:36.336768 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:36.340001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:36.347717 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.348163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.348935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.353408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.387613 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:36.388841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:36.395972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.396761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.399991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.400775 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.574308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:36.581815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-664f037b-2de1-4700-994c-18e94023a7b3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1502 microversion: 2.1 time: 0.199540 Jun 23 11:03:36.582384 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 103/220] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:36 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:36.598015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:36.598895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:36.606164 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.606928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.607929 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:36.608586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:36.615446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:36.625140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8cd9e74e-9bc6-4df2-806f-fe650c8d116b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1504 microversion: 2.1 time: 0.293259 Jun 23 11:03:36.626397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 118/221] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:36 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:37.069577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:37.079274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79a480b8-016c-44ba-a0df-40eaee3fabc2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1513 microversion: 2.1 time: 0.484993 Jun 23 11:03:37.080658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 104/222] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:36 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1513 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:37.642618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:37.643910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:37.652530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:37.652974 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:37.653745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:37.654230 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:37.799759 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:37.810057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-942e63ea-3f84-4536-9eb7-d15b8cfe2199 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1504 microversion: 2.1 time: 0.171302 Jun 23 11:03:37.820923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 119/223] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:37 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:38.584988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:38.586581 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:38.589355 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:38.595639 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.596681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:38.597457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.597888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:38.629030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lazy-loading 'flavor' on Instance uuid b4c6bdb0-09d8-496b-998a-c2a4252c5772 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:03:38.829807 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:38.831060 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:38.843379 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.844456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:38.845162 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65684451-aeaf-4997-b45b-8effa8f39276 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/action" status: 200 len: 32 microversion: 2.1 time: 0.264847 Jun 23 11:03:38.845668 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.847033 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 105/224] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:03:38 2022] POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:03:38.850381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:38.855642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:38.857022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:38.864810 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.865355 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:38.866226 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:38.866729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:39.033074 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:39.044780 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:39.055177 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c9389d3d-f97b-4f21-bbca-7664c4f9abf0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1504 microversion: 2.1 time: 0.230904 Jun 23 11:03:39.060449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 120/225] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:38 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:39.066754 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21b4b084-91ad-479a-ac48-a1884257ad93 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.215208 Jun 23 11:03:39.067331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 106/226] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:38 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:39.230585 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-06940ff2-3d28-4def-ad8b-0ec836e82d3a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'create', calling method: .version_select at 0x7f089c88f700>, body: {"keypair": {"name": "tempest-keypair-1960839918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdAPlxaM9WDKwh9g0xShRjlSeM+tgeX+GPPrNfNIEQF1c3gNgN5bClXrLv+IWaNBFZMvKdVX8ABH6ULZrpMCah2BKz7JLtgnWwHD4VDleRCTIw9DxcEmrGQoehStoC/ZQ=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:39.245015 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-06940ff2-3d28-4def-ad8b-0ec836e82d3a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for project 172a9e51095e47318b27881dab868355. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:39.250539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-06940ff2-3d28-4def-ad8b-0ec836e82d3a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for user 94bcc16975124f728459d3c28b97f1a8 and project 172a9e51095e47318b27881dab868355. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:39.278144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-06940ff2-3d28-4def-ad8b-0ec836e82d3a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.215314 Jun 23 11:03:39.279220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 121/227] 10.222.0.65 () {62 vars in 1199 bytes} [Thu Jun 23 11:03:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 11:03:40.074704 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:40.075917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:40.085465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:40.086605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:40.097623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:40.100085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:40.101131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:40.109254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:40.110840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:40.123767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:40.124900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:40.125699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:40.657538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:40.668870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-088a97df-29b4-4fc2-a02a-6c34a3719fb9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.587404 Jun 23 11:03:40.677519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 122/228] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:40 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:40.681463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:40.691281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fcb5e681-cc9d-4a38-b03c-9dab4704b53b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1504 microversion: 2.1 time: 0.621859 Jun 23 11:03:40.703435 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 107/229] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:40 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1504 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:41.687072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:41.687859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:41.694593 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:41.695151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:41.696423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:41.696860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:41.710730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:41.711410 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:41.731037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:41.731490 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:41.732290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:41.732715 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:41.885617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:41.894451 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b418370f-980a-47b2-bf40-9d8a98a7605d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.211186 Jun 23 11:03:41.905145 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 123/230] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:41 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:41.946118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-5b546f3e-1251-463d-9fbb-3dd117c07c2c req-188fecdf-1bd5-4386-a13b-d11d020d1b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d33040-550a-41b4-8a1e-3c4c12dac3f4", "name": "network-vif-deleted", "tag": "e2791f05-4320-4a12-805d-2a7b21ddd3ca"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:41.962620 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5b546f3e-1251-463d-9fbb-3dd117c07c2c req-188fecdf-1bd5-4386-a13b-d11d020d1b11 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:41.963472 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5b546f3e-1251-463d-9fbb-3dd117c07c2c req-188fecdf-1bd5-4386-a13b-d11d020d1b11 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:41.980225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-5b546f3e-1251-463d-9fbb-3dd117c07c2c req-188fecdf-1bd5-4386-a13b-d11d020d1b11 service nova] Creating event network-vif-deleted:e2791f05-4320-4a12-805d-2a7b21ddd3ca for instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 on hv-cinder-84330 Jun 23 11:03:41.986939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-5b546f3e-1251-463d-9fbb-3dd117c07c2c req-188fecdf-1bd5-4386-a13b-d11d020d1b11 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046957 Jun 23 11:03:41.988333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 124/231] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:42.025872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:42.056780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6697ce96-08c1-43ff-9f33-943c445c1442 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 200 len: 1462 microversion: 2.1 time: 0.350883 Jun 23 11:03:42.060989 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 108/232] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:41 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 1462 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:42.250124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-3105341", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cde6b719-8052-4ec2-a733-c2d79d7cb320"}], "security_groups": [{"name": "tempest-securitygroup--981724777"}], "key_name": "tempest-keypair-1960839918", "user_data": "}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:42.324565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f581868-9c79-4328-95f5-c26a3c6214ab", "device": "/dev/sdb"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:42.326073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:42.361296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:42.361747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:42.362596 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:42.370816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:42.415565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] validate_networks() for [('cde6b719-8052-4ec2-a733-c2d79d7cb320', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:03:42.825061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b87dc568-99fd-417c-a6cd-d5c864584047 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "POST /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511358 Jun 23 11:03:42.829251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 109/233] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:03:42 2022] POST /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:42.912739 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:42.913655 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:42.927012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:42.929727 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:42.930544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:42.930989 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:43.019777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:03:43.020376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:03:43.020658 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:03:43.021279 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:03:43.021846 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:03:43.033654 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:43.034528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:43.035967 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:43.036577 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:43.067216 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for project 172a9e51095e47318b27881dab868355. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:43.074767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for user 94bcc16975124f728459d3c28b97f1a8 and project 172a9e51095e47318b27881dab868355. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:43.118750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:03:43.121867 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:03:43.225639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9e604af4-a329-403b-8d61-1f1ca6e738e6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.978494 Jun 23 11:03:43.227755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 125/234] 10.222.0.65 () {62 vars in 1187 bytes} [Thu Jun 23 11:03:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 11:03:43.245932 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:43.251310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 89d33040-550a-41b4-8a1e-3c4c12dac3f4] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:43.261028 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:43.262031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:43.263008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:43.263617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:43.280930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] HTTP exception thrown: Instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 could not be found. Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Request method failure captured: Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 HTTP/1.1 Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEhljlHfpk7h6BOSq6Bw3J0BpKZbuiAUeYeFqPTZ8vjvqE1yGhsmVEfyn1f0Fxc6hd1WWLJrFBZ70-FNlnyr7Gtavl1WO6SMZHGkhMy-2w2FqRRifwJBKONXRDn-5JlCaaWaacPghVk-V4Wi4qaqhTHDNpS-y5YM19FgnAamjtVdW1M Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 1da9afa4daa046239d16a594150a994c Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesActionsTest-1723627089 Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:03:43.282978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1da9afa4daa046239d16a594150a994c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1da9afa4daa046239d16a594150a994c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1da9afa4daa046239d16a594150a994c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1da9afa4daa046239d16a594150a994c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesActionsTest-1723627089 Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 1da9afa4daa046239d16a594150a994c Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesActionsTest-1723627089 Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesActionsTest-1723627089-project Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 17071129652c4fa09b3b4b20c0dc0725 Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesActionsTest-1723627089-project Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 could not be found. Jun 23 11:03:43.284524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '89d33040-550a-41b4-8a1e-3c4c12dac3f4'} Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 could not be found. Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:03:43.285413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 could not be found. Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 could not be found. Jun 23 11:03:43.286744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:03:43.290712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Returning 404 to user: Instance 89d33040-550a-41b4-8a1e-3c4c12dac3f4 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:03:43.291783 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-05a248fb-71ef-44ee-800b-776e4f9ee24b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4" status: 404 len: 111 microversion: 2.1 time: 0.060236 Jun 23 11:03:43.293462 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 126/235] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:43 2022] GET /compute/v2.1/servers/89d33040-550a-41b4-8a1e-3c4c12dac3f4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:43.298837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-50cb5355-289e-4b0b-b37e-d8e690bf8230 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:43.300572 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-50cb5355-289e-4b0b-b37e-d8e690bf8230 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:43.392473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-50cb5355-289e-4b0b-b37e-d8e690bf8230 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:43.402073 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-50cb5355-289e-4b0b-b37e-d8e690bf8230 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:43.409188 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-50cb5355-289e-4b0b-b37e-d8e690bf8230 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:43.410808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-50cb5355-289e-4b0b-b37e-d8e690bf8230 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1279 microversion: 2.20 time: 0.116135 Jun 23 11:03:43.413075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 127/236] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:43 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:43.503075 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:43.507773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-405744757", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "networks": [{"uuid": "97c23ceb-2864-4713-821e-e19a5b81f5fe"}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:43.516957 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ac9950ce-4eed-4ba1-8d52-b0cea6f8bdb3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.608404 Jun 23 11:03:43.518759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 110/237] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:42 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:43.574365 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] validate_networks() for [('97c23ceb-2864-4713-821e-e19a5b81f5fe', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:03:44.066000 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:03:44.066790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:03:44.067380 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:03:44.067942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:03:44.068450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:03:44.078568 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:44.079020 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:44.079862 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:44.080299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:44.106075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Getting quotas for project 1da9afa4daa046239d16a594150a994c. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:44.111054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Getting quotas for user 17071129652c4fa09b3b4b20c0dc0725 and project 1da9afa4daa046239d16a594150a994c. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:44.125476 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:03:44.127633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:03:44.214822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-83c785b6-4f79-4dfb-9efb-e5d6a516d20c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711421 Jun 23 11:03:44.215513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 128/238] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:03:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:03:44.226509 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-556db447-0b71-4ee2-ab75-a545bec36412 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:44.228809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-556db447-0b71-4ee2-ab75-a545bec36412 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:44.305358 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-556db447-0b71-4ee2-ab75-a545bec36412 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:44.316235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-556db447-0b71-4ee2-ab75-a545bec36412 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1213 microversion: 2.1 time: 0.091757 Jun 23 11:03:44.316831 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 111/239] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:44 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:44.431519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:44.432420 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:44.439862 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:44.440580 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:44.441818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:44.442637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:44.523121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:44.533318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:44.533942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:44.534777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:44.536430 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:44.537752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-aaba114a-e07a-4377-a81c-428349976ad4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1331 microversion: 2.20 time: 0.111191 Jun 23 11:03:44.538383 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 129/240] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:44 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:44.554414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:44.555793 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:44.556574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:44.557194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:44.762514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:44.785335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-53835f7c-d26d-4b6d-aab2-7163bc6a926f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.255815 Jun 23 11:03:44.787644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 112/241] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:44 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:45.334037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:45.334647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:45.343502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:45.346646 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:45.347705 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:45.348429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:45.557406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:45.558778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:45.567745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:45.568543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:45.569536 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:45.570093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:45.590887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:45.600809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-dd7ceb18-a774-4dc7-b5b1-bb42571c458e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1265 microversion: 2.1 time: 0.270802 Jun 23 11:03:45.602228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 130/242] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:45 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:45.694534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:45.706284 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:45.708629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:45.709976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d20183b5-1328-4486-b886-54a1f4f28203 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1337 microversion: 2.20 time: 0.157974 Jun 23 11:03:45.710843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 113/243] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:45 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1337 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:45.809884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:45.810991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:45.823453 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:45.825666 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:45.835379 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:45.838457 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:46.129010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:46.137492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ab826839-c008-4621-a82a-a1ba1970ae58 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.338300 Jun 23 11:03:46.138069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 131/244] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:45 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:46.618814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:46.619425 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:46.631112 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:46.632270 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:46.633966 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:46.634395 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:46.639085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:46.729119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:46.729845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:46.736108 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:46.736770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:46.737549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:46.737987 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:46.824106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:46.834206 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:46.836251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:46.838107 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-25b6a675-291d-4520-8403-1aea86ec04a8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1337 microversion: 2.20 time: 0.112488 Jun 23 11:03:46.840669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 132/245] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:46 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1337 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:03:47.032421 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:47.047089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-81a483a7-c791-4263-9204-32fc90eb191d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.432069 Jun 23 11:03:47.048632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 114/246] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:46 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:47.154296 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:47.154913 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:47.161134 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:47.161828 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:47.162615 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:47.163059 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:47.488932 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:47.505959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-744239b0-4d48-45e5-b569-02a37e59f729 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.355360 Jun 23 11:03:47.520992 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 133/247] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:47 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:47.664546 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-02caf9a5-8e8c-4acd-961d-97173ac74ba6 req-8fddb46c-d8f5-4466-80bb-0ec10496a4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188173a9-f1d2-4d75-b1f1-944f9ddeaf43", "tag": "6a1fa192-71ec-456d-ae93-a0fd2a213549"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:47.677156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-02caf9a5-8e8c-4acd-961d-97173ac74ba6 req-8fddb46c-d8f5-4466-80bb-0ec10496a4b7 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:47.679124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-02caf9a5-8e8c-4acd-961d-97173ac74ba6 req-8fddb46c-d8f5-4466-80bb-0ec10496a4b7 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:47.701597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-02caf9a5-8e8c-4acd-961d-97173ac74ba6 req-8fddb46c-d8f5-4466-80bb-0ec10496a4b7 service nova] Creating event network-changed:6a1fa192-71ec-456d-ae93-a0fd2a213549 for instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 on hv-cinder-84330 Jun 23 11:03:47.707949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-02caf9a5-8e8c-4acd-961d-97173ac74ba6 req-8fddb46c-d8f5-4466-80bb-0ec10496a4b7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046941 Jun 23 11:03:47.711615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 115/248] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:47.857782 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:47.859037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:47.865188 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:47.866053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:47.867994 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:47.868648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:48.068493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:48.069704 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:48.079383 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:48.080605 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:48.081605 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:48.082796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:48.120791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:48.132524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:48.134078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:48.135191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4e9215bf-e083-4022-aa95-3e14b4c52e6f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.282489 Jun 23 11:03:48.139549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 134/249] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:47 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:48.362733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:48.373842 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18d4ec05-4cb2-45b9-9b35-17fb6b093c7e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.311932 Jun 23 11:03:48.389980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 116/250] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:48 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:48.529270 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:48.532172 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:48.541616 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-fa192f7c-3ee0-446b-8f17-7a44cb77bcaa req-23c7a192-73dc-4055-8d8c-8c8fea85f6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:48.566886 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:48.568406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-fa192f7c-3ee0-446b-8f17-7a44cb77bcaa req-23c7a192-73dc-4055-8d8c-8c8fea85f6b0 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:48.568844 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:48.573876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:48.574720 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-fa192f7c-3ee0-446b-8f17-7a44cb77bcaa req-23c7a192-73dc-4055-8d8c-8c8fea85f6b0 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:48.575392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:48.600444 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-fa192f7c-3ee0-446b-8f17-7a44cb77bcaa req-23c7a192-73dc-4055-8d8c-8c8fea85f6b0 service nova] Creating event network-changed:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:03:48.606075 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-fa192f7c-3ee0-446b-8f17-7a44cb77bcaa req-23c7a192-73dc-4055-8d8c-8c8fea85f6b0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070453 Jun 23 11:03:48.606956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 117/251] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:48.738694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:48.753278 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3083b179-d799-42a2-83b4-f4109f98dd1e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.229738 Jun 23 11:03:48.754767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 135/252] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:48 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:49.156959 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:49.157650 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:49.164963 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:49.165409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:49.166163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:49.166595 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:49.324609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:49.340881 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:49.343299 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:49.344949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4b1967c-397b-4dc0-b79c-18fbefab9cb1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.192448 Jun 23 11:03:49.346188 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 118/253] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:49 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:49.392288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:49.393833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:49.404226 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:49.404965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:49.406073 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:49.406822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:49.412946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:49.722442 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:49.739873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cbb93515-85c1-46bf-9e8e-b1028227486a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.352925 Jun 23 11:03:49.754009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 136/254] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:49 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:49.770559 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:49.771300 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:49.781078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:49.783608 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:49.788138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:49.788905 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:49.962336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:49.971132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d7b0aa4-5052-432a-a719-14f1146f87ff tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.204552 Jun 23 11:03:49.973358 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 119/255] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:49 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:50.379785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:50.380450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:50.397300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:50.397923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:50.399095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:50.399568 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:50.757425 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:50.758090 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:50.771780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:50.778552 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:50.785249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:50.785814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:50.957527 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:50.966156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:50.967691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:50.968831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-82932843-3d3f-4f5d-ba71-e7d83351d81b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.608183 Jun 23 11:03:50.969400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 137/256] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:50 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:50.999904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:51.001054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:51.009393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:51.011144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:51.031488 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:51.032468 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:51.169432 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:51.181768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b84fcef-62b3-4e8e-b8b5-0093ec751505 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.428899 Jun 23 11:03:51.185096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 120/257] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:50 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:51.339172 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:51.357638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-80a842e7-c294-4207-855a-1fc5eb537a1d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.369801 Jun 23 11:03:51.358217 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 138/258] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:50 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:51.987962 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:51.989668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:52.003246 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:52.005024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:52.006041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:52.007597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:52.199017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:52.199741 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:52.207561 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:52.208283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:52.209297 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:52.210337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:52.440629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:52.453559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-da29f66b-439f-4673-b06b-2177d90e3e9b tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.259036 Jun 23 11:03:52.468327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 139/259] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:52 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:52.473838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:52.474633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:52.482083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:52.482547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:52.483981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:52.484613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:52.501060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:52.511888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:52.514223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:52.516321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a3fc4234-6849-4310-a5f0-548f10f99921 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.533180 Jun 23 11:03:52.517757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 121/260] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:51 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:52.927449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:52.949794 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bf8c9b82-e4ff-4c47-9249-83c32a516ee0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.480416 Jun 23 11:03:52.950378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 140/261] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:52 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:53.472294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:53.473492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:53.479769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:53.480218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:53.480986 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:53.481588 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:53.542853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:53.544616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:53.552938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:53.553709 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:53.554618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:53.555763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:53.703254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:53.711231 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:53.712982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:53.714351 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1f6f003a-a2cb-4ec7-88cc-67321250b743 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.181639 Jun 23 11:03:53.725282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:53.725436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 141/262] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:53 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:53.733245 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d35aed5d-ff2d-4089-b8f0-b315bdf83b14 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.264680 Jun 23 11:03:53.735712 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 122/263] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:53 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:53.968311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:53.970208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:53.983009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:53.983779 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:53.984763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:53.985345 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:54.093936 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=4 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:54.120710 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=18 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:54.164645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:54.174035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-744cbf38-c8a5-4a05-bd48-c18c45c5a2e0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.210773 Jun 23 11:03:54.174625 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 142/264] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:53 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:54.733625 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:54.734301 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:54.738012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:54.742947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:54.743401 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:54.744206 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:54.744637 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:54.753317 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:54.754511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:54.760831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:54.761763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:54.762862 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:54.763588 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:54.902325 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:54.910819 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:54.913621 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:54.913824 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:54.915283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d3aa67d-bf2a-4b41-bacd-7bb1b31d940e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.186194 Jun 23 11:03:54.915919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 123/265] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:54 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:54.926339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-99dbd870-ca8f-4b3e-b4a1-df1e3501831f tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.178793 Jun 23 11:03:54.927001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 143/266] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:54 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:55.010863 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:55.011352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:55.024312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.024822 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.025603 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.026069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.051244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c401c205-4c7d-47de-b11b-85305161818f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/ips" status: 200 len: 149 microversion: 2.1 time: 0.044409 Jun 23 11:03:55.051842 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 144/267] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:03:55 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:55.097580 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a17df2d9-f9da-41ad-b212-382e6f635d8f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Action: 'create', calling method: .version_select at 0x7f089ca5b9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-789488599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7wdV66CnlZQlTD4xAkWzaYHE9XiWvHu4aRWPq5f8igte885IkvCaUxjzQkZQwqW7Ti/RvwjXhysneUMIloYeq9QznkvDGY1G4ItsWi5z1bnZ5ExV76n1RA44f9NIsZlw=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:55.112877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a17df2d9-f9da-41ad-b212-382e6f635d8f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:03:55.116692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-a17df2d9-f9da-41ad-b212-382e6f635d8f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for user 8f8da2142b9e4751b436cfd4920587a0 and project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:03:55.138480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a17df2d9-f9da-41ad-b212-382e6f635d8f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.221038 Jun 23 11:03:55.139096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 124/268] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:03:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:55.191977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:55.192526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:55.200635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.201818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.202730 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.203239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.405458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:55.417046 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-15986bcb-6ad5-4a7a-8506-0d8fec2790ad tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.227642 Jun 23 11:03:55.424377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 145/269] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:55 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:55.934404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:55.935066 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:55.942465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.943147 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.944278 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.944919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.952164 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:55.952884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:55.959422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.960003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:55.960856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:55.961400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:56.104343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:56.113377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:56.114770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:56.116452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e578479-9337-4ec6-8a56-87a56ed3c63c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.187023 Jun 23 11:03:56.127958 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 125/270] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:55 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:56.330326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:56.342091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9a4e7172-d7a8-4a32-a16d-7a3edfd85c4c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.399843 Jun 23 11:03:56.346529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 146/271] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:55 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:56.432280 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:56.432955 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:56.443013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:56.443464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:56.444324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:56.444702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:56.485861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3de9a110-0a72-4fa4-9e53-ada4db1c82a7"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:56.487004 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:56.492883 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:56.516392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:56.517011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:56.518002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:56.518589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:56.747130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:56.760603 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-55d83cba-ee61-43bd-92a9-7c7cd1cfdf20 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.332268 Jun 23 11:03:56.772770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 126/272] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:56 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:56.780073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a53ba5ae-3fd9-4ffb-b199-e636b2dc52c8 req-842a7fba-8139-47a9-aca6-2548b790cf34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188173a9-f1d2-4d75-b1f1-944f9ddeaf43", "name": "network-vif-plugged", "status": "completed", "tag": "6a1fa192-71ec-456d-ae93-a0fd2a213549"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:03:56.792190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a53ba5ae-3fd9-4ffb-b199-e636b2dc52c8 req-842a7fba-8139-47a9-aca6-2548b790cf34 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:56.792838 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a53ba5ae-3fd9-4ffb-b199-e636b2dc52c8 req-842a7fba-8139-47a9-aca6-2548b790cf34 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:56.808573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a53ba5ae-3fd9-4ffb-b199-e636b2dc52c8 req-842a7fba-8139-47a9-aca6-2548b790cf34 service nova] Creating event network-vif-plugged:6a1fa192-71ec-456d-ae93-a0fd2a213549 for instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 on hv-cinder-84330 Jun 23 11:03:56.822480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a53ba5ae-3fd9-4ffb-b199-e636b2dc52c8 req-842a7fba-8139-47a9-aca6-2548b790cf34 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047607 Jun 23 11:03:56.823242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 127/273] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:03:57.135355 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:57.136834 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:57.144218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:57.144666 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:57.145445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:57.145870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:57.343187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:57.351386 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:57.353002 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:57.354258 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-700b127d-3bb7-482d-8dc9-b8307a13eb58 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.223682 Jun 23 11:03:57.355298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 128/274] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:57 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:03:57.361208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:57.361764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:57.368588 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:57.369028 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:57.369790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:57.370218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:57.509292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:57.524256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-70b84c43-52d1-4d11-9c4c-7d6b9e7bcbcc tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.163380 Jun 23 11:03:57.524256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 129/275] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:57 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:57.777574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:57.778189 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:57.784526 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:57.785055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:57.785910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:57.786345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:57.919824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:57.927256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b3c66bd-d54b-41bc-9a42-0ccb268ac8eb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.154295 Jun 23 11:03:57.927827 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 130/276] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:57 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:58.374708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:58.375324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:58.381894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:58.382348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:58.383151 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:58.383589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:58.522894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:58.532144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:58.533784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:58.534999 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1263cd36-0ad6-4a7b-813e-db5ea965d8ab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.164620 Jun 23 11:03:58.535620 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 131/277] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:58 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:03:58.543484 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:58.544159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:58.550169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:58.550612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:58.551368 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:58.551823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:58.677735 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:58.685087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-317cf1a6-bc40-455d-a35b-e32ee54814f9 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.145258 Jun 23 11:03:58.685642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 132/278] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:58 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:03:58.944564 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:58.945173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:58.951883 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:58.952334 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:58.953084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:58.953516 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:59.077473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:59.080981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:59.087760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1becb2e4-3934-49a7-9afd-fbc0c4e014e9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.146677 Jun 23 11:03:59.089284 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 133/279] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:58 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:03:59.552649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:59.553264 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:59.559647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:59.560121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:59.560872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:59.561303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:59.689801 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:59.697797 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:59.699384 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:59.700498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7085d1e6-50df-4e20-90a3-4a9438fec2d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.152144 Jun 23 11:03:59.701054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 134/280] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:03:59 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:03:59.705346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:03:59.705941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:03:59.713024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:59.713971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:59.714745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:03:59.715177 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:03:59.843554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:03:59.851104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f44ce985-617a-4381-9f2e-2990703e1e23 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.149121 Jun 23 11:03:59.851675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 135/281] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:03:59 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:00.104420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:00.105029 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:00.111279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.111759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.112518 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.112947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.244039 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:00.252398 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d02fc778-ce9a-49da-a37e-b18c83ed7bf4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.151794 Jun 23 11:04:00.253044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 136/282] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:00 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:00.510007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:00.511064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:00.517134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.517585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.518346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.518784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.543116 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-240d60b3-7c46-4e09-8595-084a2851ffac tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/ips" status: 200 len: 146 microversion: 2.1 time: 0.043680 Jun 23 11:04:00.543710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 137/283] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:04:00 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:04:00.718450 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:00.719190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:00.725694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.726138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.726883 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.727314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.876662 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:00.884996 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:00.886688 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:00.887822 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3698157-fbe0-4451-ae78-132b0fa8dca7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.173282 Jun 23 11:04:00.888373 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 138/284] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:00 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:00.893222 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:00.893377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:00.898997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.899447 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:00.900292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:00.900722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.029321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:01.036787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4a65fcd5-e645-4a6a-a209-e3293632ecde tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.147492 Jun 23 11:04:01.037369 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 139/285] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:00 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:01.270290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:01.271009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:01.277677 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.278056 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.278804 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.279235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.413232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:01.421168 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3ea62e1-fb4d-47cc-bcb5-386c6dc0376a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1499 microversion: 2.1 time: 0.154668 Jun 23 11:04:01.421735 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 140/286] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:01 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:01.437478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "662208fd-627d-44a8-a285-74530cf39ea9"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:01.438599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:01.444673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.445119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.445866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.446295 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.470664 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] HTTP exception thrown: Cannot 'attach_volume' instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 while it is in vm_state rescued Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Request method failure captured: Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/os-volume_attachments HTTP/1.1 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 74 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEg3iINLTSjOhWRw2HyLGSvSdbOBEFBaAq4FQvIugZYQsYteQvjoiPUsZO2Lo1Xct51UkJ5g4GqIPhT9BTOu6F30uw4peqpoHs_wZhBv5ySfgmZUc7qOnzP55VRXCeMhAIVQV9IWk787k55tp_M-MBaVmkM5-UcSMNjVq9aEvj7suH0 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:04:01.472347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d3db3ac9cb13453fa7bc8195bdf88fd1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 6bb5a1f18dff4395bec9c205a9937493 Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {"volumeAttachment": {"volumeId": "662208fd-627d-44a8-a285-74530cf39ea9"}} Jun 23 11:04:01.473895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Cannot 'attach_volume' instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 while it is in vm_state rescued Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'b4c6bdb0-09d8-496b-998a-c2a4252c5772', 'body': {'volumeAttachment': {'volumeId': '662208fd-627d-44a8-a285-74530cf39ea9'}}} Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:04:01.474642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 while it is in vm_state rescued Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:04:01.476250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 while it is in vm_state rescued Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Returning 409 to user: Cannot 'attach_volume' instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 while it is in vm_state rescued {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f60a011-b142-4379-9525-513cde4836ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040257 Jun 23 11:04:01.477307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 141/287] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:04:01 2022] POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 11:04:01.483377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:01.483935 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:01.489995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.490435 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.491190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.491619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.558810 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-efab3268-e4f4-495a-94fe-12d608410c49 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/action" status: 202 len: 0 microversion: 2.1 time: 0.079046 Jun 23 11:04:01.559348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 142/288] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:04:01 2022] POST /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:04:01.567601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:01.568303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:01.574951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.575389 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.576175 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.576602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.706198 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:01.714159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43dcc61d-e275-4e0f-aa1a-1cdf1d75171d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.149968 Jun 23 11:04:01.714746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 143/289] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:01 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:01.905682 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:01.906284 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:01.912921 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.913363 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:01.914119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:01.914583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:02.048267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:02.056252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:02.058315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:02.059398 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-628bbc46-b0cc-490c-8524-1cddc6fc92e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.157568 Jun 23 11:04:02.059990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 144/290] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:01 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:02.064499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:02.065093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:02.070634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:02.071073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:02.071857 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:02.072283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:02.202076 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:02.209452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-321c7acb-3efa-45c2-9c31-6383331f050e tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.148537 Jun 23 11:04:02.210004 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 145/291] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:02 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:02.732456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:02.732979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:02.739025 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:02.739468 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:02.740256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:02.740685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:02.870452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:02.878247 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b7a8e88-65be-43af-bd95-d30585262343 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.150486 Jun 23 11:04:02.878800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 146/292] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:02 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:03.078908 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:03.079562 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:03.086916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:03.087353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:03.088132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:03.089218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:03.216883 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:03.224750 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:03.226279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:03.227355 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eac60752-2de7-43b6-9567-ed6f48008a83 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.153460 Jun 23 11:04:03.227953 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 147/293] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:03 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:03.232215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:03.232805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:03.238458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:03.238944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:03.239640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:03.240084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:03.373904 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:03.381497 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a626c099-9311-474a-879c-eb2f672ba741 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.152631 Jun 23 11:04:03.382043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 148/294] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:03 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:03.895791 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:03.896393 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:03.898372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:03.904316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:03.904787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:03.905535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:03.905992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:04.235176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:04.242640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab4e7880-a80b-4edb-b680-8a2205b3e518 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.350813 Jun 23 11:04:04.243180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 149/295] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:03 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:04.248255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:04.248848 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:04.254557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:04.254997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:04.255803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:04.256235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:04.260066 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:04.399481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:04.409694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:04.411229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:04.412535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95439ac7-528f-4d89-abfb-646f6e0e9dee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.168428 Jun 23 11:04:04.413082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 150/296] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:04 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:04:04.418690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:04.419288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:04.425923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:04.426200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:04.427633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:04.428171 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:04.586931 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:04.594525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7f18a19b-19bc-4416-a033-0fc2e6d8c589 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.180503 Jun 23 11:04:04.599951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 151/297] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:04 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:05.260252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:05.261377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:05.263864 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:05.269225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:05.269665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:05.270477 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:05.270908 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:05.408765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:05.416522 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7cebd63-cfce-445b-8da4-e80d2ec206cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.160207 Jun 23 11:04:05.417310 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 152/298] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:05 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:05.431533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:05.432271 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:05.438496 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:05.439016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:05.440043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:05.440439 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:05.558208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a28324f7-3713-460b-8911-b6af35d3479a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.075590 Jun 23 11:04:05.558985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 147/299] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:03:56 2022] POST /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments => generated 194 bytes in 9078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:05.615173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:05.615173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:05.619222 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:05.621346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:05.621800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:05.622581 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:05.623026 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:05.630346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:05.633286 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:05.634585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a205e3b-d625-48f0-91f9-dbb26a176f8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.206984 Jun 23 11:04:05.645847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 153/300] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:05 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:04:05.757318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:05.765452 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9cba0320-4ecb-4b49-b81f-a7310615d9ac tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.158974 Jun 23 11:04:05.766063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 148/301] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:05 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:06.433701 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:06.434313 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:06.440911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.441302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.442067 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.442500 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.452514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-192d5530-2a55-4eb9-9ceb-4ee15bac2db0 req-647f539b-3abd-435d-a524-dc3feb3f8c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "name": "network-vif-plugged", "status": "completed", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:06.462667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-192d5530-2a55-4eb9-9ceb-4ee15bac2db0 req-647f539b-3abd-435d-a524-dc3feb3f8c22 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.463112 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-192d5530-2a55-4eb9-9ceb-4ee15bac2db0 req-647f539b-3abd-435d-a524-dc3feb3f8c22 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.476051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-192d5530-2a55-4eb9-9ceb-4ee15bac2db0 req-647f539b-3abd-435d-a524-dc3feb3f8c22 service nova] Creating event network-vif-plugged:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:04:06.481360 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-192d5530-2a55-4eb9-9ceb-4ee15bac2db0 req-647f539b-3abd-435d-a524-dc3feb3f8c22 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033069 Jun 23 11:04:06.482091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 149/302] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:06.582254 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:06.590090 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c5ed14b-fdb9-480a-870f-3e4a88562e3d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.160255 Jun 23 11:04:06.590638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 154/303] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:06 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:06.653926 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:06.654690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:06.661873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.662337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.663314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.663818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.782349 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:06.782983 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:06.789224 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.789675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.790433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:06.790856 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:06.801171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:06.809957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:06.811590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:06.812878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-247e42a4-8128-497b-bdd0-18681ac1de44 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.163761 Jun 23 11:04:06.813504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 150/304] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:06 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:04:06.922650 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:06.930176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d3b13333-ac39-4a1e-84e1-d1eadefab8d7 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.151628 Jun 23 11:04:06.930676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 155/305] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:06 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:07.340980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43154e8d-79e4-47a5-b097-16c39438daac"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:07.342051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:07.348538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:07.348988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:07.349751 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:07.350190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:07.607026 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:07.607638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:07.614444 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:07.614891 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:07.615674 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:07.616113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:07.758053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:07.766070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdaf0c2a-8360-4826-8d67-90a4aa5423e1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.163480 Jun 23 11:04:07.766636 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 156/306] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:07 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:07.830661 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:07.831193 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:07.837378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:07.837911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:07.839225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:07.839698 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:07.984920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:07.997306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:07.998884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:08.000345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2db3cabb-1c8b-499f-b1ed-8d004d693705 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.173472 Jun 23 11:04:08.000992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 157/307] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:07 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:08.006031 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:08.006644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:08.014292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:08.014816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:08.015647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:08.016203 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:08.157885 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:08.184755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:08.186946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a7d93c2f-8ecd-426d-bc04-0b445d37c537 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849941 Jun 23 11:04:08.191929 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 151/308] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:04:07 2022] POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:08.193342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6df99349-88be-41c2-aa50-6dfd5d31db16 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1313 microversion: 2.1 time: 0.191147 Jun 23 11:04:08.194035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 158/309] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:08 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:08.356401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:08.356980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:08.363109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:08.363554 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:08.364342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:08.364776 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:08.488508 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lazy-loading 'services' on Instance uuid 2e278233-9622-48db-ad2b-5431be7483f2 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:04:08.602833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-518d2de7-4ffa-4662-bb08-a4db4c3a72e6 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2/os-volume_attachments/6f581868-9c79-4328-95f5-c26a3c6214ab" status: 202 len: 0 microversion: 2.1 time: 0.251027 Jun 23 11:04:08.603417 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 152/310] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:04:08 2022] DELETE /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2/os-volume_attachments/6f581868-9c79-4328-95f5-c26a3c6214ab => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:04:08.782099 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:08.782706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:08.789183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:08.789631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:08.790387 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:08.790817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:08.920443 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:08.927767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-11fd1797-6d16-420c-b5d6-5d587189bdd9 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.149466 Jun 23 11:04:08.928321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 159/311] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:08 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:09.019291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:09.020131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:09.026418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:09.026867 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:09.027622 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:09.028083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:09.160417 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:09.168908 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:09.170406 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:09.171493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9a0a13aa-53e1-483f-aad6-4f5f6ca79116 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.156941 Jun 23 11:04:09.172109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 153/312] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:09 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:04:09.210508 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:09.211104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:09.217683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:09.218120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:09.218868 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:09.219288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:09.350774 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:09.360018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10465f28-3659-424e-a681-f612ae55d72d tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1498 microversion: 2.1 time: 0.153354 Jun 23 11:04:09.360604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 160/313] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:09 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:09.944924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:09.945502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:09.951934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:09.952386 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:09.953154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:09.953595 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.044766 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:10.045286 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:10.051738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:10.052181 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.052922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:10.053352 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.079749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:04:10.088342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:10.096613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4e95a900-fc6a-40fd-9cf6-3338b137b7cb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.155547 Jun 23 11:04:10.097745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 154/314] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:09 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:10.156603 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c708d7f-1d64-45e7-8d68-7a069ea227c0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "DELETE /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 204 len: 0 microversion: 2.1 time: 0.115908 Jun 23 11:04:10.157104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 161/315] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:04:10 2022] DELETE /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:04:10.165039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:10.165648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:10.172226 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:10.172679 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.173442 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:10.173879 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.190040 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:10.190970 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:10.197116 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:10.197563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.198326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:10.198759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:10.317686 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:10.328876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-240cd1e1-b465-4afb-a12a-1ac62219a12a tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.167511 Jun 23 11:04:10.329944 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 155/316] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:10 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:10.345456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:10.353935 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:10.356345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:10.357570 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2659f40a-77b0-4f0f-af11-4332b7b9d15f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.171840 Jun 23 11:04:10.358187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 162/317] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:10 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:11.115176 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:11.115842 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:11.123176 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:11.123630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:11.125250 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:11.125763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:11.255632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:11.263141 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9f78cbc2-c59a-463d-8c26-56da600943b2 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.152609 Jun 23 11:04:11.263699 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 156/318] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:11 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:11.346492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:11.347152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:11.353726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:11.356078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:11.356078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:11.356078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:11.377253 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:11.378059 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:11.385171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:11.385715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:11.386575 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:11.387111 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:11.497562 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:11.505303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d96188fe-afba-4b05-aead-538eec33715c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.162621 Jun 23 11:04:11.505796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 163/319] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:11 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:11.523803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:11.532245 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:11.533789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:11.534937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c6af6aa6-4b80-479c-a235-13bcd38b9cfe tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.162346 Jun 23 11:04:11.535506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 157/320] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:11 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:04:12.279990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:12.280589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:12.286677 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:12.287121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:12.287901 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:12.288337 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:12.415565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:12.423564 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13b43e5d-1494-4276-801c-2909b644fb44 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.147431 Jun 23 11:04:12.426205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 164/321] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:12 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:12.521405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:12.522010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:12.528536 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:12.528984 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:12.529744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:12.530179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:12.553059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:12.553658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:12.560728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:12.561164 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:12.561915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:12.562339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:12.566534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:12.659963 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:12.667986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a9fc277b-6797-46cb-a31c-ed99c2d5cea0 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.150337 Jun 23 11:04:12.668647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 158/322] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:12 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:12.697134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:12.705371 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:12.706922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:12.708194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-63c17469-9f66-4539-88b6-37a16649f9ef tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.159085 Jun 23 11:04:12.708744 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 165/323] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:12 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:13.441252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:13.441855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:13.448829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:13.449283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:13.450074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:13.450510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:13.581126 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:13.588512 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0ec07e8c-5fdf-45d6-9b4e-3e556fb26dd6 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.151186 Jun 23 11:04:13.589736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 159/324] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:13 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:13.685742 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:13.686373 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:13.692980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:13.693363 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:13.694114 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:13.694543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:13.726332 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:13.726941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:13.733070 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:13.733525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:13.734296 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:13.734735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:13.822576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:13.830608 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3d45dac9-de1c-4b53-aba9-7533dd024679 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.149282 Jun 23 11:04:13.831161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 166/325] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:13 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:13.864736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:13.873425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:13.875201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:13.876345 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6df05902-a45e-4800-8e2d-7d820a966902 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.153963 Jun 23 11:04:13.876893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 160/326] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:13 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:14.606819 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:14.607415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:14.613475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:14.613917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:14.614676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:14.615099 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:14.744287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:14.751913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-45b579fa-0ee3-4315-8806-b4d920c5ac64 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.149661 Jun 23 11:04:14.752475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 167/327] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:14 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:14.848150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:14.848687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:14.855290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:14.855800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:14.856586 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:14.857051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:14.894326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:14.894930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:14.901037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:14.901487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:14.902250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:14.903259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:14.990401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:14.997935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-02cad5a2-c3a6-4b48-80c7-3e11719848d3 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.153699 Jun 23 11:04:14.998502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 161/328] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:14 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:15.037687 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:15.045598 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:15.047217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:15.048381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c47db05-378e-4a6b-9fe7-6e56afbf0121 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1404 microversion: 2.20 time: 0.158122 Jun 23 11:04:15.048932 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 168/329] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:14 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:04:15.768678 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:15.769291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:15.775387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:15.775876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:15.776673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:15.777113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:15.906077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:15.913458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c25ce4c7-659c-429d-94b5-424879cef267 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1507 microversion: 2.1 time: 0.148666 Jun 23 11:04:15.914013 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 162/330] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:15 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:16.015152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:16.015807 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:16.022525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.022922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.023708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.024142 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.065532 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:16.066524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:16.072666 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.073112 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.073869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.074426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.156853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:16.164891 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a8c0cee0-ed61-4a2f-8a05-e138a629d3ec tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.153737 Jun 23 11:04:16.166536 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 169/331] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:16 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:16.232517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:16.240493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:16.242007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:16.243143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6d4bd2f6-8440-40d3-9e7d-6d72b8067b3c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1596 microversion: 2.20 time: 0.181497 Jun 23 11:04:16.243700 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 163/332] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:04:16 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1596 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:04:16.260706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:16.261197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:16.267091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.267545 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.269511 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.269986 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.346733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0233576b-9ae3-4968-a0cc-0cf90babaef9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089837 Jun 23 11:04:16.347453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 170/333] 10.222.0.65 () {60 vars in 1315 bytes} [Thu Jun 23 11:04:16 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:04:16.930293 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:16.931565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:16.938486 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.938931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:16.939730 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:16.940337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:17.163240 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:17.171952 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0e39ae7a-7af1-4a4e-9789-3757ebf7fe60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1513 microversion: 2.1 time: 0.245432 Jun 23 11:04:17.172603 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 164/334] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:16 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:17.191789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:17.192181 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:17.199340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:17.199887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:17.200890 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:17.202685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:17.534196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:17.542043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7267351d-5b6c-498d-bbb1-28c580840b09 tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1504 microversion: 2.1 time: 0.357651 Jun 23 11:04:17.542611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 171/335] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:17 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:17.940153 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-dbbd00be-1cb1-41e2-8396-6e22cfffcb68 req-7b2be4cf-c59c-4ba5-a2ce-b838529a8af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188173a9-f1d2-4d75-b1f1-944f9ddeaf43", "name": "network-vif-deleted", "tag": "6a1fa192-71ec-456d-ae93-a0fd2a213549"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:17.952364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-dbbd00be-1cb1-41e2-8396-6e22cfffcb68 req-7b2be4cf-c59c-4ba5-a2ce-b838529a8af9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:17.953598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-dbbd00be-1cb1-41e2-8396-6e22cfffcb68 req-7b2be4cf-c59c-4ba5-a2ce-b838529a8af9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:17.965424 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-dbbd00be-1cb1-41e2-8396-6e22cfffcb68 req-7b2be4cf-c59c-4ba5-a2ce-b838529a8af9 service nova] Creating event network-vif-deleted:6a1fa192-71ec-456d-ae93-a0fd2a213549 for instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 on hv-cinder-84330 Jun 23 11:04:17.970714 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-dbbd00be-1cb1-41e2-8396-6e22cfffcb68 req-7b2be4cf-c59c-4ba5-a2ce-b838529a8af9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036485 Jun 23 11:04:17.971359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 165/336] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:18.561915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:18.563012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:18.568525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4614eae2-6827-478f-a4e2-885369e5bccc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'create', calling method: .version_select at 0x7f089c8a9d30>, body: {"keypair": {"name": "tempest-keypair-18194251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbK0DEKmNPoq8PsSibGWvcv0q3nZ8MY+bplNIzOR/pT1Wzt4PBU6r+zf/XfDGIr9+M8eIjezbMJ0q1nWHrNbbWky1pHP0AoNHlROFFyabwWkPTMI4ZMczN8Z4hCXS7F7g=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:18.580885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:18.581654 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:18.582560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:18.583297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:18.584239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-4614eae2-6827-478f-a4e2-885369e5bccc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:04:18.588396 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-4614eae2-6827-478f-a4e2-885369e5bccc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for user 6bb5a1f18dff4395bec9c205a9937493 and project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:04:18.612517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4614eae2-6827-478f-a4e2-885369e5bccc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047951 Jun 23 11:04:18.619818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 166/337] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:04:18 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:04:18.632270 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:18.633426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:18.634228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lazy-loading 'fault' on Instance uuid 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:04:18.690826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17071129652c4fa09b3b4b20c0dc0725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da9afa4daa046239d16a594150a994c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:18.705197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3478ccb8-4e7e-4ffa-bb92-2b296c34cccd tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 200 len: 1303 microversion: 2.1 time: 0.148764 Jun 23 11:04:18.707722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 172/338] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:18 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:19.722749 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:19.723474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] [instance: 188173a9-f1d2-4d75-b1f1-944f9ddeaf43] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:19.729638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:19.730063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:19.731579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:19.732049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:19.745172 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] HTTP exception thrown: Instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 could not be found. Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Request method failure captured: Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 HTTP/1.1 Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEhljlHfpk7h6BOSq6Bw3J0BpKZbuiAUeYeFqPTZ8vjvqE1yGhsmVEfyn1f0Fxc6hd1WWLJrFBZ70-FNlnyr7Gtavl1WO6SMZHGkhMy-2w2FqRRifwJBKONXRDn-5JlCaaWaacPghVk-V4Wi4qaqhTHDNpS-y5YM19FgnAamjtVdW1M Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 1da9afa4daa046239d16a594150a994c Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesActionsTest-1723627089 Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:04:19.746809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1da9afa4daa046239d16a594150a994c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1da9afa4daa046239d16a594150a994c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1da9afa4daa046239d16a594150a994c", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1da9afa4daa046239d16a594150a994c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesActionsTest-1723627089 Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 1da9afa4daa046239d16a594150a994c Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesActionsTest-1723627089 Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesActionsTest-1723627089-project Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 17071129652c4fa09b3b4b20c0dc0725 Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesActionsTest-1723627089-project Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 could not be found. Jun 23 11:04:19.748310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '188173a9-f1d2-4d75-b1f1-944f9ddeaf43'} Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 could not be found. Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:04:19.749077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 could not be found. Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 could not be found. Jun 23 11:04:19.750461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:04:19.751444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] Returning 404 to user: Instance 188173a9-f1d2-4d75-b1f1-944f9ddeaf43 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:04:19.751444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5ccec440-383e-4b77-bb01-6dcc3dc56d6c tempest-VolumesActionsTest-1723627089 tempest-VolumesActionsTest-1723627089-project] 10.222.0.65 "GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43" status: 404 len: 111 microversion: 2.1 time: 0.029873 Jun 23 11:04:19.751444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 167/339] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:19 2022] GET /compute/v2.1/servers/188173a9-f1d2-4d75-b1f1-944f9ddeaf43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:04:19.978631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2032410995", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19e128cb-e174-49db-a8d2-8534db57c32e"}], "security_groups": [{"name": "tempest-securitygroup--91579734"}], "key_name": "tempest-keypair-18194251", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:19.986816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-1df17795-014e-49d1-ad5e-cfbec3119b52 req-9dade679-0182-4c3b-92b4-c8a65fd0f1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:19.997176 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-1df17795-014e-49d1-ad5e-cfbec3119b52 req-9dade679-0182-4c3b-92b4-c8a65fd0f1e9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:19.999986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-1df17795-014e-49d1-ad5e-cfbec3119b52 req-9dade679-0182-4c3b-92b4-c8a65fd0f1e9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:20.012284 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-1df17795-014e-49d1-ad5e-cfbec3119b52 req-9dade679-0182-4c3b-92b4-c8a65fd0f1e9 service nova] Creating event network-changed:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:04:20.017144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-1df17795-014e-49d1-ad5e-cfbec3119b52 req-9dade679-0182-4c3b-92b4-c8a65fd0f1e9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034574 Jun 23 11:04:20.018223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 168/340] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:04:20.089062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] validate_networks() for [('19e128cb-e174-49db-a8d2-8534db57c32e', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:04:20.733992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:04:20.734415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:04:20.734892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:04:20.735299 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:04:20.735736 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:04:20.744983 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:20.745430 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:20.746225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:20.747199 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:20.764603 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:04:20.768820 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Getting quotas for user 6bb5a1f18dff4395bec9c205a9937493 and project d3db3ac9cb13453fa7bc8195bdf88fd1. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:04:20.780278 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:04:20.782563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:04:20.830762 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18c30d12-7bc4-4afe-bb0c-891a91f04033 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.857344 Jun 23 11:04:20.831635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 173/341] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:04:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:04:20.842955 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b3ad77b5-6070-44a4-8cff-759ab810097f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:20.844118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b3ad77b5-6070-44a4-8cff-759ab810097f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:20.906961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b3ad77b5-6070-44a4-8cff-759ab810097f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:20.913679 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b3ad77b5-6070-44a4-8cff-759ab810097f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1244 microversion: 2.1 time: 0.075572 Jun 23 11:04:20.914428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 169/342] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:20 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1244 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:21.930567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:21.931167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:21.937790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:21.938232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:21.938982 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:21.939408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:22.001705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:22.008909 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-01658773-4558-4021-acf8-2b5bf67cd0db tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1248 microversion: 2.1 time: 0.082696 Jun 23 11:04:22.009453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 174/343] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:21 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1248 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:23.026087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:23.026750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:23.034028 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:23.034478 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:23.035239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:23.035704 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:23.097855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:23.105232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8408c53a-8479-4d9b-88da-d440f8454131 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1248 microversion: 2.1 time: 0.082998 Jun 23 11:04:23.106496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 170/344] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:23 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:24.122739 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:24.123727 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:24.131642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:24.132117 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:24.132885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:24.133320 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:24.198856 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:24.206757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d4550108-60c0-45da-a3ad-dcb4b337eb7d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1248 microversion: 2.1 time: 0.088354 Jun 23 11:04:24.207308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 175/345] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:24 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:24.844385 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1981103746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-789488599", "security_groups": [{"name": "tempest-secgroup-smoke-1647556123"}], "block_device_mapping_v2": [{"uuid": "5e3759df-4a38-4821-8d6d-5e001da6637f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c33ca82f-6e79-4afd-a43f-c1b68283a4eb"}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:24.960283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] validate_networks() for [('c33ca82f-6e79-4afd-a43f-c1b68283a4eb', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:04:25.223602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:25.224322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:25.230926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:25.231400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:25.232814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:25.233250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:25.294046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:25.301420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1bbe9efa-5ee4-4d28-a03a-0971c3b2272e tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1296 microversion: 2.1 time: 0.081648 Jun 23 11:04:25.301987 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 176/346] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:25 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:25.336362 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:04:25.336785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:04:25.337255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:04:25.337667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:04:25.338073 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:04:25.347404 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:25.347835 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:25.348639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:25.349072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:25.355866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:25.368242 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:04:25.372247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for user 8f8da2142b9e4751b436cfd4920587a0 and project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:04:25.428510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:04:25.430605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e3759df-4a38-4821-8d6d-5e001da6637f',volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:04:25.572529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6c0840f1-ab4a-418a-aca0-dc07a4af694b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731950 Jun 23 11:04:25.573172 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 171/347] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:04:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:04:25.583374 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8200f6a0-407c-44ee-831e-aacd4be06463 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:25.584019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8200f6a0-407c-44ee-831e-aacd4be06463 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:25.664538 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8200f6a0-407c-44ee-831e-aacd4be06463 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:25.676279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8200f6a0-407c-44ee-831e-aacd4be06463 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1094 microversion: 2.1 time: 0.096015 Jun 23 11:04:25.677100 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 177/348] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:25 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:25.959039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bb65f2d2-4a30-4222-941d-220cd1a0b39e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: .version_select at 0x7f089c7c6f70>, body: {"keypair": {"name": "tempest-keypair-818101925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTGz8qN4tkw9HbsFNp2ZjScJvWzb1cTsXcJIXRgi9IxUJA552BF22dqxDqY0Le86xvF5Eg1Fgf1L1MZYddLaxes+IOlk+1NvGc5xB7tpVqI+kpdDk5M67ea7KtDWN7D7Q=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:25.984560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-bb65f2d2-4a30-4222-941d-220cd1a0b39e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:04:25.990263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-bb65f2d2-4a30-4222-941d-220cd1a0b39e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:04:26.030048 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bb65f2d2-4a30-4222-941d-220cd1a0b39e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075628 Jun 23 11:04:26.048486 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 172/349] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:04:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:26.319594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:26.320339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:26.335160 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:26.335644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:26.337564 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:26.338049 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:26.456178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:26.472798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdfe9fbd-d518-4d19-9fe0-d84fe6276434 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1302 microversion: 2.1 time: 0.157805 Jun 23 11:04:26.483738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 178/350] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:26 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1302 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:26.695868 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:26.696421 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:26.698401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:26.723847 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:26.724387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:26.725361 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:26.725804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:26.923255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:26.931500 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7925b9fa-f527-433d-a262-4e8f6368b057 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1192 microversion: 2.1 time: 0.240717 Jun 23 11:04:26.932719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 173/351] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:26 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1192 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:27.489753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:27.490364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:27.497135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:27.498043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:27.499062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:27.499774 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:27.729655 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:27.742115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e1f4b81f-2dea-4771-b82c-1c54ed018379 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.256044 Jun 23 11:04:27.752410 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 179/352] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:27 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:27.949965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:27.950752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:27.969848 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:27.970758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:27.975888 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:27.976674 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:28.293983 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-b766fbe0-9063-43cf-8930-ef221d14326b req-fdd00ed0-13c7-4ad7-8566-0ceb1949f3ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3faa61-9238-40ad-bc81-1ed5bf84f0d3", "tag": "3909cef4-3010-4515-8cab-d60278b2d3ee"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:28.319378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b766fbe0-9063-43cf-8930-ef221d14326b req-fdd00ed0-13c7-4ad7-8566-0ceb1949f3ad service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:28.320439 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b766fbe0-9063-43cf-8930-ef221d14326b req-fdd00ed0-13c7-4ad7-8566-0ceb1949f3ad service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:28.367597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-b766fbe0-9063-43cf-8930-ef221d14326b req-fdd00ed0-13c7-4ad7-8566-0ceb1949f3ad service nova] Creating event network-changed:3909cef4-3010-4515-8cab-d60278b2d3ee for instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 on hv-cinder-84330 Jun 23 11:04:28.376528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-b766fbe0-9063-43cf-8930-ef221d14326b req-fdd00ed0-13c7-4ad7-8566-0ceb1949f3ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086178 Jun 23 11:04:28.392266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:28.393973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 180/353] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:28.402131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f06c0852-f8f2-4b9b-81a8-e3262321e536 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1210 microversion: 2.1 time: 0.455990 Jun 23 11:04:28.405678 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 174/354] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:27 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1210 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:28.768684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:28.768684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:28.769231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:28.769614 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:28.770923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:28.771579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:28.925306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1676992967", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b879fb0c-6f1b-457c-8797-97d9533d8257"}], "security_groups": [{"name": "tempest-securitygroup--107664407"}], "key_name": "tempest-keypair-818101925", "user_data": "}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:29.007574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:29.016172 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0a62e815-50df-40a2-a73c-e3313026307c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.260197 Jun 23 11:04:29.017353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 181/355] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:28 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:29.090515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] validate_networks() for [('b879fb0c-6f1b-457c-8797-97d9533d8257', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:04:29.422038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:29.423342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:29.431191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:29.432130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:29.433149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:29.433805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:29.678475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:29.689287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88b48696-39b2-41ff-b5d5-c328a94f05bb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.272846 Jun 23 11:04:29.690457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 182/356] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:29 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:29.696604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:04:29.697014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:04:29.697489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:04:29.697891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:04:29.698481 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:04:29.710111 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:29.710801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:29.711816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:29.712437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:29.731354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:04:29.735649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:04:29.747129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:04:29.749891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:04:29.825640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ff8e4fc3-0604-4288-b5af-37c82a795442 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.904512 Jun 23 11:04:29.826548 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 175/357] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:04:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:04:29.836941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9b80dd8b-919c-45b4-9d4f-27eb68f1f981 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:29.840840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9b80dd8b-919c-45b4-9d4f-27eb68f1f981 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:29.909249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9b80dd8b-919c-45b4-9d4f-27eb68f1f981 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:29.919144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9b80dd8b-919c-45b4-9d4f-27eb68f1f981 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1241 microversion: 2.1 time: 0.086242 Jun 23 11:04:29.921021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 183/358] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:29 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:30.035275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:30.036970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:30.045672 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:30.046534 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:30.048038 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:30.048289 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:30.242358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:30.249552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-71bf91ab-c5f4-4dd6-be24-811fabf272e8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.220098 Jun 23 11:04:30.251173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 176/359] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:30 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:30.706729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:30.707342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:30.723037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:30.725176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:30.726101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:30.726730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:30.777110 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:30.937471 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:30.938087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:30.952761 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:30.953361 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:30.956375 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:30.957321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:30.974659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:30.990433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1bd4961-a412-4362-9f4a-b59b9c2d939d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.286197 Jun 23 11:04:30.991393 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 184/360] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:30 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:31.089588 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:31.101337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4f68071d-2a9a-4a3a-8291-cf8f11354647 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1293 microversion: 2.1 time: 0.167730 Jun 23 11:04:31.101481 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 177/361] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:30 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1293 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:31.267961 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:31.268878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:31.277223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:31.295346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:31.296259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:31.298073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:31.299187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:31.316909 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:31.507752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-0807a57b-9a72-4517-a3c9-a853660a254e req-a397cac5-43ef-4628-bd20-5d7eba682bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f49b10a-300a-4cca-bc81-35841bde257c", "tag": "5cc271a1-6f9b-43a0-963f-fc7a9395a997"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:31.532612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-0807a57b-9a72-4517-a3c9-a853660a254e req-a397cac5-43ef-4628-bd20-5d7eba682bf2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:31.534078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-0807a57b-9a72-4517-a3c9-a853660a254e req-a397cac5-43ef-4628-bd20-5d7eba682bf2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:31.557327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-0807a57b-9a72-4517-a3c9-a853660a254e req-a397cac5-43ef-4628-bd20-5d7eba682bf2 service nova] Creating event network-changed:5cc271a1-6f9b-43a0-963f-fc7a9395a997 for instance 6f49b10a-300a-4cca-bc81-35841bde257c on hv-cinder-84330 Jun 23 11:04:31.589316 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-0807a57b-9a72-4517-a3c9-a853660a254e req-a397cac5-43ef-4628-bd20-5d7eba682bf2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082807 Jun 23 11:04:31.590058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 178/362] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:31.998769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:32.009102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-13c9ce7e-fdc4-4b60-bb2f-37482876d29a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.746628 Jun 23 11:04:32.011327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:32.012352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:32.020511 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 185/363] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:31 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:32.025319 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:32.025891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:32.026819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:32.027294 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:32.118303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:32.119183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:32.126425 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:32.127124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:32.129060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:32.129826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:32.208267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:32.217455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7fb4cc9-3b19-4c4d-90bf-38fe84f5930c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1299 microversion: 2.1 time: 0.102512 Jun 23 11:04:32.218495 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:32.225878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 186/364] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:32 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:32.228244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-782c0097-7232-4469-a588-410c30173e23 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.222123 Jun 23 11:04:32.229177 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 179/365] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:32 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:32.946853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-84bf44ed-cefd-4c75-898a-c58c3d1c866a req-a8984fb7-8772-4227-90c8-4d79990573ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3faa61-9238-40ad-bc81-1ed5bf84f0d3", "name": "network-vif-plugged", "status": "completed", "tag": "3909cef4-3010-4515-8cab-d60278b2d3ee"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:32.965408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-84bf44ed-cefd-4c75-898a-c58c3d1c866a req-a8984fb7-8772-4227-90c8-4d79990573ae service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:32.967169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-84bf44ed-cefd-4c75-898a-c58c3d1c866a req-a8984fb7-8772-4227-90c8-4d79990573ae service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:32.994303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-84bf44ed-cefd-4c75-898a-c58c3d1c866a req-a8984fb7-8772-4227-90c8-4d79990573ae service nova] Creating event network-vif-plugged:3909cef4-3010-4515-8cab-d60278b2d3ee for instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 on hv-cinder-84330 Jun 23 11:04:33.002630 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-84bf44ed-cefd-4c75-898a-c58c3d1c866a req-a8984fb7-8772-4227-90c8-4d79990573ae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063143 Jun 23 11:04:33.005978 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 187/366] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:33.026477 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:33.027114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:33.041134 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:33.041593 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:33.042367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:33.042804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:33.238260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:33.239264 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:33.254817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:33.255542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:33.257833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:33.258606 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:33.452052 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:33.466595 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:33.475340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9c8be4a-314a-4f25-991a-1cd18d42e1de tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.243700 Jun 23 11:04:33.476264 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 188/367] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:33 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:33.488440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-57870ddb-f857-43f6-90e4-48971eee50b0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.465393 Jun 23 11:04:33.489037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 180/368] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:33 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:33.501024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:33.502065 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:33.515294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:33.516097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:33.518455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:33.519366 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:33.723606 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:33.731540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b98dd92c-7723-49d0-8b03-16a2f68b296e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.244947 Jun 23 11:04:33.733305 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 189/369] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:33 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:34.015188 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0a8f0cc6-5312-4080-9542-815c69246cd1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:34.028150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a8f0cc6-5312-4080-9542-815c69246cd1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.029411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a8f0cc6-5312-4080-9542-815c69246cd1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.112017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0a8f0cc6-5312-4080-9542-815c69246cd1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Going to try to stop instance {{(pid=117878) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:04:34.179988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0a8f0cc6-5312-4080-9542-815c69246cd1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action" status: 202 len: 0 microversion: 2.1 time: 0.177925 Jun 23 11:04:34.181466 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 181/370] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:04:34 2022] POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:04:34.197821 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:34.199254 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:34.210068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.211183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.212245 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.212875 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.436899 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:34.446730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-28895105-12c7-4ca2-950c-1f830d611a93 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.260839 Jun 23 11:04:34.448586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 190/371] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:34 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:34.494930 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:34.496036 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:34.514285 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:34.514898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:34.520128 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.520680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.521515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.521953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.531422 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.531896 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.532668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.538158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.773853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:34.782783 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df9f18dc-e8da-4f41-a449-7023283c1c60 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.281150 Jun 23 11:04:34.792341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 191/372] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:34 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:34.799052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:34.800010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:34.808377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.808947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.809918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.810907 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.862572 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:34.874476 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b6781dc6-bbe7-43d0-8b3c-1d2174f0e1b5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.383556 Jun 23 11:04:34.875578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 182/373] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:34 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:34.886673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-7a4343d0-3e90-4521-97bf-c9325f36fc8d req-45adbdb6-e19f-4534-970c-6af6668526f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5", "tag": "b7535b31-8d71-494f-97b9-054dc6058267"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:34.900440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-7a4343d0-3e90-4521-97bf-c9325f36fc8d req-45adbdb6-e19f-4534-970c-6af6668526f0 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:34.903448 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-7a4343d0-3e90-4521-97bf-c9325f36fc8d req-45adbdb6-e19f-4534-970c-6af6668526f0 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:34.916594 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-7a4343d0-3e90-4521-97bf-c9325f36fc8d req-45adbdb6-e19f-4534-970c-6af6668526f0 service nova] Creating event network-changed:b7535b31-8d71-494f-97b9-054dc6058267 for instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 on hv-cinder-84330 Jun 23 11:04:34.921818 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-7a4343d0-3e90-4521-97bf-c9325f36fc8d req-45adbdb6-e19f-4534-970c-6af6668526f0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044880 Jun 23 11:04:34.925781 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 183/374] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:34.991942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:35.001202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39691c50-c82b-463f-bde8-8c1860b28a38 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.215904 Jun 23 11:04:35.002727 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 192/375] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:34 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:35.468044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:35.468743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:35.474902 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.475355 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.476165 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.476602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.627716 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:35.639362 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6216ab42-da31-482f-b39e-44b3e71f55d5 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.177073 Jun 23 11:04:35.640223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 184/376] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:35 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:35.689195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:35.690348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:35.698895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.699697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.700477 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.700952 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.767880 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:04:35.801381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:35.802047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:35.812798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.813296 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.814101 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.814534 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.900414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-88bb4e6d-9407-4887-b698-b65f0ab1c018 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 204 len: 0 microversion: 2.1 time: 0.213141 Jun 23 11:04:35.900414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 193/377] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:04:35 2022] DELETE /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:04:35.905984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:35.907166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:35.913500 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.914025 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:35.914861 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:35.915356 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:36.036681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:36.047090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-04bbf625-584b-472b-bff6-1c5d39fb2c09 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1368 microversion: 2.1 time: 0.250879 Jun 23 11:04:36.047672 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 185/378] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:35 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:36.052750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:36.056098 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:36.062244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:36.062694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:36.063680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:36.064120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:36.090580 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:36.103979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b15e31ae-0b99-4733-8ac2-a3f54d2eecdf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.203869 Jun 23 11:04:36.104549 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 194/379] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:35 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:36.108972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:36.109569 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:36.115558 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:36.116018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:36.116778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:36.117215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:36.231584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:36.239397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2352ad86-ef45-414c-9ae7-214b971b53b7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1513 microversion: 2.1 time: 0.190217 Jun 23 11:04:36.239995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 186/380] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:36 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:36.272285 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:36.279555 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb8940f0-fae7-4553-8233-269ce01aad8e tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.174082 Jun 23 11:04:36.280334 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 195/381] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:36 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:36.657055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:36.657652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:36.680597 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:36.681210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:36.682757 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:36.683793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.064345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:37.065918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:37.073210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.073737 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.075442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.076331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.162138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:37.178420 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1d24d8d3-55b2-403f-9871-22da8c1a3498 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.525224 Jun 23 11:04:37.188005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 187/382] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:36 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:37.190168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:37.191256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:37.203939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.205252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.206514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.207459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.244971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:37.254928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ce301aa4-c0ed-4171-b51b-c0ff7f870954 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1562 microversion: 2.1 time: 0.194571 Jun 23 11:04:37.255722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 196/383] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:37 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:37.272475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:37.273436 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:37.280492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.280933 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.281968 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.282464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.374533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:37.385835 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1378968c-9634-477a-96e2-8bf6a0c4cefd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.199950 Jun 23 11:04:37.386473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 188/384] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:37 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:37.393575 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:37.394428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:37.403773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.404787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.405577 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.406021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.428219 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:37.436760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dfbce2e3-3a64-4773-9386-19b53b4726a7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1513 microversion: 2.1 time: 0.168411 Jun 23 11:04:37.437416 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 197/385] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:37 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:37.442194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:37.442898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:37.449527 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.450260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.451561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:37.452275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:37.532546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-43d0bc13-86a2-49c4-80de-414f0fff6b11 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144521 Jun 23 11:04:37.539249 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 189/386] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:04:37 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:37.618536 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:37.633602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3946c6c-525c-48b2-8887-e1d61cdab2da tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.194832 Jun 23 11:04:37.635436 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 198/387] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:37 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:38.200544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:38.203867 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:38.215364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.217949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.221717 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.222388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.408013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:38.409448 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:38.416648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.417483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.418598 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.419325 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.488741 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:38.492404 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:38.502554 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0b6cd51e-d816-42c8-89eb-83a244a7e88e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.308569 Jun 23 11:04:38.504674 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 190/388] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:38 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:38.511440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:38.512236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:38.521356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.521797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.522608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.523044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.626524 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:38.636316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-96d2e26a-fcc1-4bb3-8d80-fe000456d3a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.236429 Jun 23 11:04:38.636901 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 199/389] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:38 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:38.653097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:38.653757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:38.663848 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.664299 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.665070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.665976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.783235 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:38.790860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e762894d-5f51-473f-8df6-6c808601c650 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1513 microversion: 2.1 time: 0.284360 Jun 23 11:04:38.792158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 191/390] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:38 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:38.797156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-2bb5df58-6001-43f3-8488-c8d30aae1436 req-49e4649b-7a2d-4575-ad01-cf1073d464b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3faa61-9238-40ad-bc81-1ed5bf84f0d3", "tag": "3909cef4-3010-4515-8cab-d60278b2d3ee"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:38.805978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-2bb5df58-6001-43f3-8488-c8d30aae1436 req-49e4649b-7a2d-4575-ad01-cf1073d464b6 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:38.806418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-2bb5df58-6001-43f3-8488-c8d30aae1436 req-49e4649b-7a2d-4575-ad01-cf1073d464b6 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:38.819109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-2bb5df58-6001-43f3-8488-c8d30aae1436 req-49e4649b-7a2d-4575-ad01-cf1073d464b6 service nova] Creating event network-changed:3909cef4-3010-4515-8cab-d60278b2d3ee for instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 on hv-cinder-84330 Jun 23 11:04:38.824027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-2bb5df58-6001-43f3-8488-c8d30aae1436 req-49e4649b-7a2d-4575-ad01-cf1073d464b6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030693 Jun 23 11:04:38.827508 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 192/391] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:38.845436 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:38.849905 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:38.856332 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79c5d55f-c38b-4b4c-b6d5-494b9a794036 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1278 microversion: 2.1 time: 0.206895 Jun 23 11:04:38.857119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 200/392] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:38 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:39.525865 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:39.534460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:39.545541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:39.546334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:39.552349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:39.558391 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:39.655181 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:39.656060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:39.676274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:39.677324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:39.678485 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:39.679113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:39.721405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=4 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:39.742499 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=22 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:39.764298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:39.774003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1127553f-60b0-4a0a-b537-f7dab2bc212f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.255711 Jun 23 11:04:39.783620 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 193/393] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:39 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:39.808891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:39.809741 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:39.819119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:39.819728 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:39.820665 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:39.821199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:39.914100 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=10 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:39.984822 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:39.996022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-181f7543-a023-4b61-94c6-4c4369b85278 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.346092 Jun 23 11:04:40.005298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 201/394] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:39 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:40.006292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:40.007000 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:40.013229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:40.013683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:40.014614 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:40.014885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:40.033807 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:40.043104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d927d536-2a95-4e44-b012-5d6955abfc33 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1513 microversion: 2.1 time: 0.237845 Jun 23 11:04:40.053063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 194/395] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:39 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:40.405632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:40.415077 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c580325b-5b9d-4153-bcb5-0199f103a8aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.416907 Jun 23 11:04:40.426579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 202/396] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:39 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:40.580623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-0314bba1-543a-4fda-a24d-e00dd7307742 req-93b1e9f8-b7ce-45c5-9f99-0ac7d118ca50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e278233-9622-48db-ad2b-5431be7483f2", "name": "network-vif-deleted", "tag": "a0add7ed-5464-4c4c-bb48-b733b2757101"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:40.591971 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-0314bba1-543a-4fda-a24d-e00dd7307742 req-93b1e9f8-b7ce-45c5-9f99-0ac7d118ca50 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:40.592719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-0314bba1-543a-4fda-a24d-e00dd7307742 req-93b1e9f8-b7ce-45c5-9f99-0ac7d118ca50 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:40.605958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-0314bba1-543a-4fda-a24d-e00dd7307742 req-93b1e9f8-b7ce-45c5-9f99-0ac7d118ca50 service nova] Creating event network-vif-deleted:a0add7ed-5464-4c4c-bb48-b733b2757101 for instance 2e278233-9622-48db-ad2b-5431be7483f2 on hv-cinder-84330 Jun 23 11:04:40.612654 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-0314bba1-543a-4fda-a24d-e00dd7307742 req-93b1e9f8-b7ce-45c5-9f99-0ac7d118ca50 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036849 Jun 23 11:04:40.613810 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 195/397] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:40.794000 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:40.795341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:40.804026 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:40.804934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:40.807701 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:40.808345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:40.957244 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:40.965705 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-221bf6ff-f6df-4e15-8311-c5019210c716 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.178640 Jun 23 11:04:40.966811 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 203/398] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:40 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:41.013972 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:41.014851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:41.021843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.022414 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.023284 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.023848 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.062875 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:41.063506 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:41.069931 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.070529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.071315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.072030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.111470 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.111971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.112651 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lazy-loading 'fault' on Instance uuid 2e278233-9622-48db-ad2b-5431be7483f2 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:04:41.170434 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:41.179176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a63a2155-38aa-43ea-b814-7399fda4dcd7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1309 microversion: 2.1 time: 0.122101 Jun 23 11:04:41.189413 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 204/399] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:41 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:41.211910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:41.219566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a0f88bfc-0d30-4632-95fd-e56c41f9b245 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.210325 Jun 23 11:04:41.220158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 196/400] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:41 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:41.431890 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:41.432772 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:41.440672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.440672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.440672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.441072 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.584330 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:41.593171 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-92d0150f-ad12-494d-b19a-2136f07530a0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.164685 Jun 23 11:04:41.595775 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 205/401] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:41 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:41.986341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:41.987722 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:41.994373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.994813 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:41.995582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:41.996035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.149582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:42.163541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5e5ebd9c-b143-4b12-9ef1-93024f1f8db0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.180959 Jun 23 11:04:42.164426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 197/402] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:41 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:42.198649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:42.199282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:42.207027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.207475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.220982 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.221826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.244892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:42.244892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:42.246174 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.246636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.249006 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.252029 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.269934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.271247 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.273341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lazy-loading 'fault' on Instance uuid 2e278233-9622-48db-ad2b-5431be7483f2 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:04:42.378229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:42.387355 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-647877fd-b743-462b-8d56-472bc785cba4 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 200 len: 1309 microversion: 2.1 time: 0.192726 Jun 23 11:04:42.388047 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 206/403] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:42 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:42.462838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:42.471005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b365af07-ec25-448b-8298-e23eb206437a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.238312 Jun 23 11:04:42.471781 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 198/404] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:42 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:42.614871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:42.615644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:42.624175 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.624857 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.626043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:42.626602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:42.863215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:42.877827 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-03eaf07c-6a8a-4d8c-b922-e4df0394a024 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.267625 Jun 23 11:04:42.878979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 207/405] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:42 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:43.184431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:43.185688 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:43.196537 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.198403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.199362 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.200202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.353731 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:43.367485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-272ccfd8-2818-4131-b48c-b4ca79c17478 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.189028 Jun 23 11:04:43.378306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 199/406] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:43 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:43.405169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:43.406385 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 2e278233-9622-48db-ad2b-5431be7483f2] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:43.413379 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.414038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.414965 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.415389 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.430203 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] HTTP exception thrown: Instance 2e278233-9622-48db-ad2b-5431be7483f2 could not be found. Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Request method failure captured: Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 HTTP/1.1 Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEhfToQOhYXx6oEOkwoFesNMcrzf_q5KwEY1LTHpfeZx0Uw8ovOGB5VRiynxNQfaoty6bUlzGB1egf9LDwTFfxk4kc8yyU-akU_U0g8kc95Ax4luWmbDsi_SAQO4DDZyg3rrMOopsRZTuvELN6zqrlLkO_WjsmKo2on79MDsGT4wGIM Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 64682ed401c74af7aa436a2171819ebe Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1613631908 Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:04:43.432122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64682ed401c74af7aa436a2171819ebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64682ed401c74af7aa436a2171819ebe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64682ed401c74af7aa436a2171819ebe", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64682ed401c74af7aa436a2171819ebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotTestJSON-1613631908 Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 64682ed401c74af7aa436a2171819ebe Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1613631908 Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotTestJSON-1613631908-project Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 1b0423a12e39453e9cd6d1e8ab43af60 Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotTestJSON-1613631908-project Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 2e278233-9622-48db-ad2b-5431be7483f2 could not be found. Jun 23 11:04:43.433643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '2e278233-9622-48db-ad2b-5431be7483f2'} Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e278233-9622-48db-ad2b-5431be7483f2 could not be found. Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:04:43.434642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e278233-9622-48db-ad2b-5431be7483f2 could not be found. Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e278233-9622-48db-ad2b-5431be7483f2 could not be found. Jun 23 11:04:43.436152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:04:43.438240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Returning 404 to user: Instance 2e278233-9622-48db-ad2b-5431be7483f2 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:04:43.439227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4504872d-09e6-44e9-affb-5b3dd63ec7e7 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2" status: 404 len: 111 microversion: 2.1 time: 0.038537 Jun 23 11:04:43.439945 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 208/407] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:43 2022] GET /compute/v2.1/servers/2e278233-9622-48db-ad2b-5431be7483f2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:04:43.489342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:43.490105 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:43.499149 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.500475 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.505446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.506156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.711587 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:43.725564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-aaac6dee-12ea-4bf3-816c-bd8d5116e61c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.235099 Jun 23 11:04:43.733239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 200/408] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:43 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:43.894431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:43.895351 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:43.901971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.902419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:43.903189 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:43.903626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:44.056622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:44.065203 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7ab00d71-823a-432b-8496-dea7b2579d13 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.174614 Jun 23 11:04:44.075404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 209/409] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:43 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:44.386349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:44.387774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:44.395891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:44.396584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:44.397355 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:44.397934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:44.538281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:44.547112 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ea32cb7a-30ce-4482-a879-54d8ad8a5065 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.164528 Jun 23 11:04:44.547787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 201/410] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:44 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:44.751850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:44.753399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:44.759859 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:44.760542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:44.761631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:44.762403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:44.913044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:44.920704 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-95cfa2b8-3534-4b06-84a1-d46ae6f2f434 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.174052 Jun 23 11:04:44.921437 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 210/411] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:44 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:45.082830 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:45.083431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:45.103977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:45.104421 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:45.105375 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:45.105706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:45.262961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:45.271321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5087a02a-dece-4537-a9d2-8e6e0401561c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.192212 Jun 23 11:04:45.272267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 202/412] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:45 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:45.565490 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:45.566109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:45.572487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:45.572939 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:45.573749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:45.574187 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:45.719465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:45.729268 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-684b04ac-5b3f-4a24-b6cc-164e88b57fc9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.168840 Jun 23 11:04:45.729858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 211/413] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:45 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:45.938075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:45.938623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:45.945236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:45.945756 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:45.946609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:45.947115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:46.088069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:46.097643 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f6b3e64a-5cb4-435c-9883-046ba68ba997 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.163391 Jun 23 11:04:46.098412 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 203/414] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:45 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:46.288339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:46.288940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:46.295496 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:46.295973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:46.296732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:46.297161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:46.429087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:46.436465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e752a075-1c87-4564-9c23-b4ff03e15457 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.151995 Jun 23 11:04:46.437011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 212/415] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:46 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:46.746887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:46.747441 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:46.754326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:46.754773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:46.755532 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:46.755991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:46.885220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:46.893647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-758f41b0-2292-48c0-a250-443ab6e98350 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.150689 Jun 23 11:04:46.894201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 204/416] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:46 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:47.114264 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:47.114870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:47.120871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.121309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:47.122057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.122487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:47.255312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:47.262765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2c85530c-070f-480f-98d4-ed3dfb98afaf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.152358 Jun 23 11:04:47.263314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 213/417] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:47 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:47.452996 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:47.453624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:47.460084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.460546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:47.461301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.461736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:47.586612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:47.594517 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-18037929-e692-467f-a96c-d52525a47dd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.145371 Jun 23 11:04:47.595075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 205/418] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:47 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:47.911360 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:47.912010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:47.918747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.919333 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:47.920138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.920568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:47.988752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-5b9595fc-426c-4d64-a789-6bbd849da44e req-ebbfa2ee-7682-4915-8266-9a136759991d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5", "name": "network-vif-plugged", "status": "completed", "tag": "b7535b31-8d71-494f-97b9-054dc6058267"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:47.998023 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5b9595fc-426c-4d64-a789-6bbd849da44e req-ebbfa2ee-7682-4915-8266-9a136759991d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:47.998670 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5b9595fc-426c-4d64-a789-6bbd849da44e req-ebbfa2ee-7682-4915-8266-9a136759991d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:48.015314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-5b9595fc-426c-4d64-a789-6bbd849da44e req-ebbfa2ee-7682-4915-8266-9a136759991d service nova] Creating event network-vif-plugged:b7535b31-8d71-494f-97b9-054dc6058267 for instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 on hv-cinder-84330 Jun 23 11:04:48.023631 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-5b9595fc-426c-4d64-a789-6bbd849da44e req-ebbfa2ee-7682-4915-8266-9a136759991d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038874 Jun 23 11:04:48.024800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 206/419] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:48.095223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:48.106092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e61875c4-f689-4a3b-beee-0789c5271240 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.198977 Jun 23 11:04:48.107207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 214/420] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:47 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:48.279790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:48.280643 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:48.286789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:48.287229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:48.288003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:48.288433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:48.417773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:48.425842 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-89cc3b5b-10b3-4f34-94ca-4151fec13570 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.150263 Jun 23 11:04:48.426475 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 207/421] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:48 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:48.610913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:48.611533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:48.618129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:48.618597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:48.619361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:48.619830 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:48.787117 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:48.795151 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7a690c0c-8cea-4a1c-b22b-41564704816d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.188029 Jun 23 11:04:48.795733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 215/422] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:48 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:49.124618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:49.125394 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:49.132506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:49.132992 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:49.134045 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:49.134407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:49.289288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:49.298426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-049b0740-6de3-4d1f-9768-11f1a3a2656f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.179531 Jun 23 11:04:49.298989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 208/423] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:49 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:49.442759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:49.443293 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:49.449840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:49.450317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:49.451593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:49.452060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:49.585315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:49.593436 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35cfd67e-8161-4f72-9443-53dfc07d6c2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.154645 Jun 23 11:04:49.594007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 216/424] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:49 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:49.811645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:49.812274 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:49.818349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:49.818800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:49.819559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:49.820024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:49.839915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:49.949191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:49.957584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cab1669e-5325-4800-9492-deca25a78ad3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.150236 Jun 23 11:04:49.958145 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 209/425] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:49 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:50.316375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:50.316984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:50.323176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:50.323631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:50.324427 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:50.324864 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:50.343225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:50.499708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:50.508099 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-550573d1-279c-49aa-b0c2-ef02c5096e34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.195535 Jun 23 11:04:50.508812 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 217/426] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:50 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:50.610634 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:50.611354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:50.617934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:50.618379 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:50.619147 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:50.620205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:50.840786 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:50.849657 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d6f03e5a-1249-4a6f-9a2e-47f049e75e45 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.243232 Jun 23 11:04:50.850207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 210/427] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:50 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:50.974363 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:50.975096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:50.981169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:50.981614 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:50.982368 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:50.982796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:51.122169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:51.131059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc4aaaf7-8feb-491e-9813-08e68cdf199b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.160352 Jun 23 11:04:51.131781 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 218/428] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:50 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:51.524642 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:51.525262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:51.531400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:51.531893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:51.532668 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:51.533098 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:51.881159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:51.881924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:51.889144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:51.889732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:51.890658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:51.891189 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:51.921570 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:51.930006 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0621f055-736e-4345-b776-6db2a7f66b34 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.409209 Jun 23 11:04:51.930596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 211/429] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:51 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:52.036731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:52.044557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e8ccabb8-c718-4b26-885a-37b643697fd6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1366 microversion: 2.1 time: 0.181873 Jun 23 11:04:52.045918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 219/430] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:51 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:52.149239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:52.150060 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:52.156806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:52.157255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:52.158021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:52.158455 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:52.293644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:52.301804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-861d5460-7f9f-4efe-a8ba-e153ac78069c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.156471 Jun 23 11:04:52.302364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 212/431] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:52 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:52.486002 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1105947707", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "networks": [{"uuid": "90335769-5abc-4a45-87f8-aca0c9113916"}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:52.537315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] validate_networks() for [('90335769-5abc-4a45-87f8-aca0c9113916', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:04:52.883180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:04:52.883845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:04:52.884765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:04:52.885096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:04:52.885513 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:04:52.895893 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:52.896343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:52.897176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:52.897612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:52.914101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Getting quotas for project 64682ed401c74af7aa436a2171819ebe. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:04:52.918236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Getting quotas for user 1b0423a12e39453e9cd6d1e8ab43af60 and project 64682ed401c74af7aa436a2171819ebe. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:04:52.929710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:04:52.931992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:04:52.946624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:52.947381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:52.956563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:52.957051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:52.957826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:52.958380 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:52.976706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-42357058-4362-49a4-bc48-93fe789979ba tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494656 Jun 23 11:04:52.977378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 220/432] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:04:52.987084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dc46421d-90c5-450b-a747-21ae4e4f38cb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:52.988154 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dc46421d-90c5-450b-a747-21ae4e4f38cb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:53.045260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dc46421d-90c5-450b-a747-21ae4e4f38cb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:53.053925 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dc46421d-90c5-450b-a747-21ae4e4f38cb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1219 microversion: 2.1 time: 0.070573 Jun 23 11:04:53.054493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 221/433] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:52 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:53.069756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:53.070528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:53.072522 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:53.081298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.081814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.082671 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.083176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.106161 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:53.115287 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d2b489b6-28d0-4ede-b3b2-0369620600c2 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.172734 Jun 23 11:04:53.119691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 213/434] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:52 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:53.224223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:53.232488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a1e57e6e-1d14-4393-9ad6-6a42dbd88529 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1556 microversion: 2.1 time: 0.166238 Jun 23 11:04:53.233046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 222/435] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:53 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:53.250064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:53.250918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:53.258851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.259373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.260250 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.260676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.318536 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:53.319216 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:53.325412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.325816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.326764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:53.327055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:53.344395 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bb5cb737-cb55-4be2-8cdf-66952ba77fb8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099541 Jun 23 11:04:53.350649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 214/436] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:04:53 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:53.471447 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:53.481910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e4b0f8a-421f-46a8-a649-d91b992f0c8a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.167203 Jun 23 11:04:53.483691 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 223/437] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:53 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:54.072064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:54.072604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:54.074441 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:54.081429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.081877 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.082647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.083083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.133481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:54.134102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:54.141260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.141927 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.142684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.143113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.174558 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:54.182397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c512fc4d-9887-457c-b505-9ea9618b0a76 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1271 microversion: 2.1 time: 0.115050 Jun 23 11:04:54.193103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 215/438] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:54 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:54.277328 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:54.286159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82b1b097-fcfc-4fd3-8663-5c648d0c3125 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.156799 Jun 23 11:04:54.286853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 224/439] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:54 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:54.358024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-7964ba01-56d7-464e-ae66-3adba4ccb070 req-ab7533b2-cd99-48d3-aa8c-2c318cf508c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5", "tag": "b7535b31-8d71-494f-97b9-054dc6058267"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:54.366593 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-7964ba01-56d7-464e-ae66-3adba4ccb070 req-ab7533b2-cd99-48d3-aa8c-2c318cf508c3 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.367039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-7964ba01-56d7-464e-ae66-3adba4ccb070 req-ab7533b2-cd99-48d3-aa8c-2c318cf508c3 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.379923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-7964ba01-56d7-464e-ae66-3adba4ccb070 req-ab7533b2-cd99-48d3-aa8c-2c318cf508c3 service nova] Creating event network-changed:b7535b31-8d71-494f-97b9-054dc6058267 for instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 on hv-cinder-84330 Jun 23 11:04:54.386102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-7964ba01-56d7-464e-ae66-3adba4ccb070 req-ab7533b2-cd99-48d3-aa8c-2c318cf508c3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032559 Jun 23 11:04:54.386696 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 216/440] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:54.468061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-275d7ba1-8cf8-46b5-8f5a-2edf0d45ccc5 req-67430038-98c6-4895-a6a0-05f30ca1144c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f49b10a-300a-4cca-bc81-35841bde257c", "name": "network-vif-plugged", "status": "completed", "tag": "5cc271a1-6f9b-43a0-963f-fc7a9395a997"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:54.476221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-275d7ba1-8cf8-46b5-8f5a-2edf0d45ccc5 req-67430038-98c6-4895-a6a0-05f30ca1144c service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.476591 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-275d7ba1-8cf8-46b5-8f5a-2edf0d45ccc5 req-67430038-98c6-4895-a6a0-05f30ca1144c service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.487460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-275d7ba1-8cf8-46b5-8f5a-2edf0d45ccc5 req-67430038-98c6-4895-a6a0-05f30ca1144c service nova] Creating event network-vif-plugged:5cc271a1-6f9b-43a0-963f-fc7a9395a997 for instance 6f49b10a-300a-4cca-bc81-35841bde257c on hv-cinder-84330 Jun 23 11:04:54.492609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-275d7ba1-8cf8-46b5-8f5a-2edf0d45ccc5 req-67430038-98c6-4895-a6a0-05f30ca1144c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028297 Jun 23 11:04:54.493716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 225/441] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:54.500354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:54.501305 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:54.510819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.511475 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.512433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:54.512873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:54.781307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:54.789770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-39b4328b-5d63-4ede-8b8d-1d79ee165b46 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.294123 Jun 23 11:04:54.790393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 217/442] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:54 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:55.201008 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:55.201615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:55.218416 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.218887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.223518 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.224052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.304330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:55.305540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:55.313700 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.314467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.315801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.316250 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.324194 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:55.331995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f0087e59-cefd-4cef-babb-cc44e7f9bc4a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1277 microversion: 2.1 time: 0.135947 Jun 23 11:04:55.332670 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 226/443] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:55 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:55.488871 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:55.497069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-860f6368-60dc-48fa-8e7b-5aef944ee5a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.196896 Jun 23 11:04:55.497654 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 218/444] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:55 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:55.806416 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:55.807207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:55.813400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.813976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.814943 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:55.815566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:55.948409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:55.956276 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c8091224-1280-46ec-b801-8be6366335b8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1266 microversion: 2.1 time: 0.153800 Jun 23 11:04:55.956841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 227/445] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:55 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:56.349808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:56.351564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:56.359161 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.359635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:56.360434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.360869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:56.402159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-46cdd4e6-0773-4fdf-a899-c38ac7e05553 req-cbc31c3f-e9d1-4d81-adac-0332d7ebc7cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f733e16-e9ed-415a-828c-1e3371b8fb2f", "tag": "60554c92-813d-4189-8fb7-1dea22dd8220"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:56.411375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-46cdd4e6-0773-4fdf-a899-c38ac7e05553 req-cbc31c3f-e9d1-4d81-adac-0332d7ebc7cb service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.411874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-46cdd4e6-0773-4fdf-a899-c38ac7e05553 req-cbc31c3f-e9d1-4d81-adac-0332d7ebc7cb service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:56.423726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-46cdd4e6-0773-4fdf-a899-c38ac7e05553 req-cbc31c3f-e9d1-4d81-adac-0332d7ebc7cb service nova] Creating event network-changed:60554c92-813d-4189-8fb7-1dea22dd8220 for instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f on hv-cinder-84330 Jun 23 11:04:56.428378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-46cdd4e6-0773-4fdf-a899-c38ac7e05553 req-cbc31c3f-e9d1-4d81-adac-0332d7ebc7cb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029965 Jun 23 11:04:56.429158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 228/446] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:04:56.506837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:56.516884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:56.517711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:56.517826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1e489b95-acdc-41ef-abb8-84681f1ea5f1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.171523 Jun 23 11:04:56.518397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 219/447] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:56 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:56.526064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.526064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:56.526064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.526064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:56.705770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:56.713847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ad81820-7f67-4c45-96fd-099e897e230f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.202352 Jun 23 11:04:56.724987 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 229/448] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:56 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:04:56.972915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:56.973571 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:56.980347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.980795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:56.981681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:56.982269 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.110117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:57.117714 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-156ab544-d5b2-4f45-9d99-5153b850a669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1453 microversion: 2.1 time: 0.148967 Jun 23 11:04:57.118266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 220/449] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:56 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:57.134805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:57.135408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:57.141938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:57.142376 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.143123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:57.143551 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.272446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:57.279816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5a874a7c-621a-4d10-aede-b42851822a17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1453 microversion: 2.1 time: 0.148780 Jun 23 11:04:57.280365 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 230/450] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:57 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:57.546829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:57.548037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:57.565443 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:57.566244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.567080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:57.568157 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.733293 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:57.734589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:57.741588 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:57.745768 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:57.754397 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.755217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:57.756116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7a030e1c-04cb-49e4-bd88-f78efc5746de tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.224695 Jun 23 11:04:57.756703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 221/451] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:57 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:57.757648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:57.980741 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:57.989498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-41201978-b8a5-4818-ae01-51eaf987d95e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.261497 Jun 23 11:04:57.990139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 231/452] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:57 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:58.772436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:58.773043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:58.780887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:58.781539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:58.782311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:58.782743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:58.922363 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:58.936254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5a41d9ce-63fa-4adf-8afb-5f6b0ddcf6e9 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.167063 Jun 23 11:04:58.937560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 222/453] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:58 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:59.008343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:59.009195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:59.016709 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:59.017400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:59.018293 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:59.018814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:59.237232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:04:59.255225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-58cef20c-e175-4b8d-8ec0-9724cab1279a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.250974 Jun 23 11:04:59.265829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 232/454] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:59 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:04:59.299021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-2b281469-a5f2-41a7-aeb3-47301da343dd req-12e22c5b-c0af-4ec7-bc46-b6aa7c7da351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f49b10a-300a-4cca-bc81-35841bde257c", "tag": "5cc271a1-6f9b-43a0-963f-fc7a9395a997"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:04:59.308356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-2b281469-a5f2-41a7-aeb3-47301da343dd req-12e22c5b-c0af-4ec7-bc46-b6aa7c7da351 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:59.308795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-2b281469-a5f2-41a7-aeb3-47301da343dd req-12e22c5b-c0af-4ec7-bc46-b6aa7c7da351 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:59.320586 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-2b281469-a5f2-41a7-aeb3-47301da343dd req-12e22c5b-c0af-4ec7-bc46-b6aa7c7da351 service nova] Creating event network-changed:5cc271a1-6f9b-43a0-963f-fc7a9395a997 for instance 6f49b10a-300a-4cca-bc81-35841bde257c on hv-cinder-84330 Jun 23 11:04:59.325431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-2b281469-a5f2-41a7-aeb3-47301da343dd req-12e22c5b-c0af-4ec7-bc46-b6aa7c7da351 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031671 Jun 23 11:04:59.327199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 223/455] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:04:59.954960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:04:59.955577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:04:59.961514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:59.961991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:04:59.962759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:04:59.963190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:00.098923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:00.106499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9ef6bfa8-b8c5-4325-b184-5d81ab8f1983 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.156450 Jun 23 11:05:00.107072 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 233/456] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:04:59 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:00.273895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:00.274599 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:00.287350 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:00.287826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:00.288652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:00.289029 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:00.424352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:00.432485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ee7c621c-ccad-4a64-8921-dd581b0073ba tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.163358 Jun 23 11:05:00.433036 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 224/457] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:00 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:01.124070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:01.124682 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:01.138290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:01.138745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:01.139521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:01.139984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:01.270911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:01.278374 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2eb3881-a9f9-46cd-a412-07c4274e057f tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.159188 Jun 23 11:05:01.278988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 234/458] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:01 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:01.449893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:01.450418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:01.457150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:01.457599 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:01.458364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:01.458798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:01.584259 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:01.592660 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5ee91123-3921-442d-b2f1-9be751bc832d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.146757 Jun 23 11:05:01.593213 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 225/459] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:01 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:02.294134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:02.294743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:02.301218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:02.301661 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:02.302413 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:02.302845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:02.429897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:02.437814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-04b7ef67-243a-4b23-a34e-31524f57d1e0 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.147582 Jun 23 11:05:02.438364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 235/460] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:02 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:02.609929 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:02.610631 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:02.617281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:02.618256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:02.618484 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:02.618950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:02.765519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:02.778846 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ba882e6c-4dcd-4879-ae03-d9e73b303b51 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.173295 Jun 23 11:05:02.789809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 226/461] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:02 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:03.455099 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:03.455625 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:03.457648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:03.458343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=8 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:03.464763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.465207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.466019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.467064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.600024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:03.607790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3c6f7070-296c-4b3b-8347-9dd3860766b1 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.157172 Jun 23 11:05:03.608366 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 236/462] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:03 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:03.796341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:03.796950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:03.803397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.803887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:03.804647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:03.805082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:04.169247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:04.173265 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:04.178550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-93e56762-bb02-4fcf-b6a7-95f28b323591 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.386037 Jun 23 11:05:04.179112 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 227/463] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:03 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:04.626113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:04.627812 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:04.635917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:04.636796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:04.638229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:04.639141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:04.650001 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:04.786906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:04.796630 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7b2fac2-1272-4f92-96ef-8b523c662a42 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.175600 Jun 23 11:05:04.797777 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 237/464] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:04 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:04.915350 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-349dc089-259f-46e6-9242-bde4d443c4f4 req-2758bccf-8cf9-4442-a728-40e058d7938e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f733e16-e9ed-415a-828c-1e3371b8fb2f", "name": "network-vif-plugged", "status": "completed", "tag": "60554c92-813d-4189-8fb7-1dea22dd8220"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:04.923836 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-349dc089-259f-46e6-9242-bde4d443c4f4 req-2758bccf-8cf9-4442-a728-40e058d7938e service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:04.924413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-349dc089-259f-46e6-9242-bde4d443c4f4 req-2758bccf-8cf9-4442-a728-40e058d7938e service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:04.936600 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-349dc089-259f-46e6-9242-bde4d443c4f4 req-2758bccf-8cf9-4442-a728-40e058d7938e service nova] Creating event network-vif-plugged:60554c92-813d-4189-8fb7-1dea22dd8220 for instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f on hv-cinder-84330 Jun 23 11:05:04.941943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-349dc089-259f-46e6-9242-bde4d443c4f4 req-2758bccf-8cf9-4442-a728-40e058d7938e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030432 Jun 23 11:05:04.942534 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 228/465] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:05.196701 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:05.197252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:05.204137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:05.204601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:05.205456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:05.205898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:05.337442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:05.345414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b208b35c-2802-4e9e-956b-739bd9a3667a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.153218 Jun 23 11:05:05.346256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 238/466] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:05 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:05.814268 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:05.814958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:05.821123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:05.821564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:05.822348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:05.822776 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:05.954884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:05.962713 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5ce88171-7a9c-4f21-a9cf-50f8baba1e0d tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.153041 Jun 23 11:05:05.963393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 229/467] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:05 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:06.366179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:06.366724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:06.373177 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:06.373617 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:06.375032 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:06.375466 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:06.503148 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:06.511024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e9d5fe9-b710-44ce-b019-3105c8fab558 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.149872 Jun 23 11:05:06.511581 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 239/468] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:06 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:06.980011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:06.980528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:06.987112 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:06.987552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:06.988348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:06.988775 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:07.132750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:07.140783 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4dde57fa-733c-461a-a627-a8e9a8eebf0a tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1319 microversion: 2.1 time: 0.164821 Jun 23 11:05:07.141336 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 230/469] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:06 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:07.527790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:07.528390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:07.534695 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:07.535129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:07.535895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:07.536318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:07.660690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:07.668491 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1a0f8cc9-0c9c-4a02-b212-14520592d8d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1724 microversion: 2.1 time: 0.144581 Jun 23 11:05:07.669052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 240/470] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:07 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:08.158524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:08.159151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:08.166021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.166658 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.167469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.167931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.306356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:08.314158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6a975593-790b-46a6-a9fb-07ca3a53d0cf tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1507 microversion: 2.1 time: 0.160236 Jun 23 11:05:08.314750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 231/471] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:08 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:08.333815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db945b27-ea18-42e6-9e18-069d9d062136", "device": "/dev/sdb"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:08.334992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:08.343327 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.344742 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.345834 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.346281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.671967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3abd5da5-512e-4633-ae66-780fea183f84 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "POST /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341548 Jun 23 11:05:08.675699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 241/472] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:05:08 2022] POST /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:08.691560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:08.692202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:08.705805 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.706257 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.707038 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.707470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.852879 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:08.861003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cefb676d-f333-4f3c-861a-faa1044aab41 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1701 microversion: 2.1 time: 0.178047 Jun 23 11:05:08.861617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 232/473] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:08 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:08.879269 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-445fcdd4-7310-4d57-b554-49033f34abea tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:08.886293 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-445fcdd4-7310-4d57-b554-49033f34abea tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:08.886745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-445fcdd4-7310-4d57-b554-49033f34abea tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:08.958214 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-445fcdd4-7310-4d57-b554-49033f34abea tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Going to try to start instance {{(pid=117877) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 11:05:08.999897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-445fcdd4-7310-4d57-b554-49033f34abea tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action" status: 202 len: 0 microversion: 2.1 time: 0.125499 Jun 23 11:05:09.001015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 242/474] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:05:08 2022] POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:05:09.009332 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:09.009941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:09.016687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:09.017124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:09.017946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:09.018403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:09.148346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:09.156281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-227d6ca8-1c7c-4887-a72d-e6b42636eaec tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1710 microversion: 2.1 time: 0.150760 Jun 23 11:05:09.157204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 233/475] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:09 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:10.174433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:10.175122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:10.181364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:10.181805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:10.182589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:10.183040 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:10.312250 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:10.320664 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44b49397-9daa-4d29-8530-9dafb95a44fd tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1710 microversion: 2.1 time: 0.151073 Jun 23 11:05:10.321224 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 243/476] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:10 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:11.338853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:11.339458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:11.346733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:11.347181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:11.348038 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:11.348425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:11.484331 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:11.492181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-74a6e245-b0ef-43f9-a3fc-a02a25bace2f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1710 microversion: 2.1 time: 0.157198 Jun 23 11:05:11.492740 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 234/477] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:11 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:12.508717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:12.509241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:12.515755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:12.516206 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:12.516993 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:12.518054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:12.654060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:12.662222 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fa3db256-a8c7-4a65-9113-7813f0dab6cc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1714 microversion: 2.1 time: 0.157364 Jun 23 11:05:12.662840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 244/478] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:12 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:23.964540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:23.965066 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:23.967613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=39 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:23.968292 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=38 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:23.973857 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:23.974305 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:23.975065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:23.975499 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:23.997692 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-00bae0d6-551c-41c6-a5e8-9a40f958db16 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/ips" status: 200 len: 151 microversion: 2.20 time: 0.037194 Jun 23 11:05:23.998246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 235/479] 10.222.0.65 () {60 vars in 1288 bytes} [Thu Jun 23 11:05:23 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:05:29.147883 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:29.148412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:29.151070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=45 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:29.151887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:29.157694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:29.158141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:29.159401 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:29.159871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:29.185153 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lazy-loading 'flavor' on Instance uuid 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:05:29.445954 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ff329f10-7af8-451d-806a-11631806ffa1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/action" status: 202 len: 0 microversion: 2.20 time: 0.301842 Jun 23 11:05:29.446565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 245/480] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Jun 23 11:05:29 2022] POST /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:05:29.454954 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:29.455564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:29.461834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:29.462286 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:29.463055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:29.463489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:29.600498 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:29.608503 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:29.610003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:29.611140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-25efacbb-8371-4981-ac9f-b20fa1a1146c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.160290 Jun 23 11:05:29.611709 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 236/481] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:29 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:05:30.072828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:30.073411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:30.079636 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:30.080118 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:30.081420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:30.081858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:30.204149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lazy-loading 'services' on Instance uuid 5f733e16-e9ed-415a-828c-1e3371b8fb2f {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:05:30.320768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93bcf25d-0a2a-49fb-81b3-4aff05b7a4f8 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f/os-volume_attachments/db945b27-ea18-42e6-9e18-069d9d062136" status: 202 len: 0 microversion: 2.1 time: 0.252087 Jun 23 11:05:30.321339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 246/482] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:05:30 2022] DELETE /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f/os-volume_attachments/db945b27-ea18-42e6-9e18-069d9d062136 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:05:30.630439 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:30.631052 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:30.637673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:30.638120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:30.639012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:30.639334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:30.765977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:30.774393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:30.775921 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:30.777063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-22860b2c-6e6d-4194-b296-0b65520e506a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.151289 Jun 23 11:05:30.777617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 237/483] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:30 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:31.796499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:31.797192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:31.804010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:31.804474 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:31.805214 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:31.805644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:31.931733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:31.939681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:31.941239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:31.942917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc316d22-03b4-4440-909f-66df6adfa543 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.151239 Jun 23 11:05:31.943464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 247/484] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:31 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:32.479901 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:32.480467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:32.486727 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:32.487171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:32.487965 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:32.488400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:32.512682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:05:32.583797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-95c0572a-6b80-4b51-a75c-045043693cdb tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 204 len: 0 microversion: 2.1 time: 0.107504 Jun 23 11:05:32.584284 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 238/485] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:05:32 2022] DELETE /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:05:32.592312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:32.592917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:32.599522 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:32.599996 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:32.600755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:32.601188 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:32.731315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:32.738818 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed5d5dae-472c-41a8-a11b-fec532999917 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1513 microversion: 2.1 time: 0.150382 Jun 23 11:05:32.739745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 248/486] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:32 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:32.962406 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:32.963024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:32.969252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:32.969699 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:32.970465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:32.970900 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:33.102367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:33.110651 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:33.112678 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:33.114354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1813c9f0-db20-433b-8321-36818d6ca331 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.156940 Jun 23 11:05:33.114906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 239/487] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:32 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:33.756329 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:33.756943 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:33.763501 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:33.763978 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:33.764748 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:33.765178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:33.892776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:33.900712 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed5a8842-25b6-475f-a07a-836cc3851c18 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1513 microversion: 2.1 time: 0.148712 Jun 23 11:05:33.901272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 249/488] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:33 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:34.132759 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:34.133360 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:34.140607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:34.141051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:34.141803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:34.142225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:34.267855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:34.275640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:34.277153 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:34.278278 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b914814b-ecc9-4f6b-aa2d-64b1e5c5ed86 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.149396 Jun 23 11:05:34.278821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 240/489] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:34 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:34.917053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:34.917655 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:34.924038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:34.924483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:34.925236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:34.925666 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:35.052779 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:35.060188 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-731fa929-d55f-4fbc-920b-18b8e3a94061 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1513 microversion: 2.1 time: 0.146900 Jun 23 11:05:35.060676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 250/490] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:34 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:35.296945 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:35.297544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:35.304771 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:35.305216 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:35.307765 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:35.308342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:35.434847 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:35.443798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:35.445294 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:35.446426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a57d4613-df2d-46e1-b1db-34e466697c9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.153444 Jun 23 11:05:35.446979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 241/491] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:35 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:36.077303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:36.077913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:36.084816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:36.085289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:36.086048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:36.086480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:36.244539 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:36.251960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3cb6ea3b-0731-49ca-b9a6-b8f0e0a71418 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1513 microversion: 2.1 time: 0.178439 Jun 23 11:05:36.252526 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 251/492] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:36 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:36.464567 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:36.465173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:36.471745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:36.472191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:36.472969 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:36.473401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:36.608201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:36.616182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:36.617891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:36.619062 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5e289ced-55fd-4cae-bd3b-539d540b6bcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.158420 Jun 23 11:05:36.619841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 242/493] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:36 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:36.657243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-de270c6f-c9d1-4f26-89b4-81625f267001 req-162f6697-c38c-4c7b-a559-92b3aa60b8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f733e16-e9ed-415a-828c-1e3371b8fb2f", "name": "network-vif-deleted", "tag": "60554c92-813d-4189-8fb7-1dea22dd8220"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:36.665681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-de270c6f-c9d1-4f26-89b4-81625f267001 req-162f6697-c38c-4c7b-a559-92b3aa60b8a4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:36.666408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-de270c6f-c9d1-4f26-89b4-81625f267001 req-162f6697-c38c-4c7b-a559-92b3aa60b8a4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:36.677164 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-de270c6f-c9d1-4f26-89b4-81625f267001 req-162f6697-c38c-4c7b-a559-92b3aa60b8a4 service nova] Creating event network-vif-deleted:60554c92-813d-4189-8fb7-1dea22dd8220 for instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f on hv-cinder-84330 Jun 23 11:05:36.682134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-de270c6f-c9d1-4f26-89b4-81625f267001 req-162f6697-c38c-4c7b-a559-92b3aa60b8a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028581 Jun 23 11:05:36.682726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 252/494] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:37.268918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:37.269526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:37.276104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:37.276549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:37.277311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:37.277743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:37.307587 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:37.308059 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:37.308504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lazy-loading 'fault' on Instance uuid 5f733e16-e9ed-415a-828c-1e3371b8fb2f {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:05:37.350724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b0423a12e39453e9cd6d1e8ab43af60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64682ed401c74af7aa436a2171819ebe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:37.357958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1e722f2f-b0c1-4e3a-9d15-b91d0442e90c tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 200 len: 1309 microversion: 2.1 time: 0.092818 Jun 23 11:05:37.358513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 243/495] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:37 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:05:37.639008 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:37.639714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:37.646359 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:37.646805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:37.647555 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:37.648017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:37.783103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:37.791399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:37.793515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:37.794836 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-37001c84-fc2e-4fbf-adac-c9dcf6332a6d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.160510 Jun 23 11:05:37.795390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 253/496] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:37 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:38.375514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:38.376147 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] [instance: 5f733e16-e9ed-415a-828c-1e3371b8fb2f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:38.384422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:38.384898 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:38.385663 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:38.386095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:38.398889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] HTTP exception thrown: Instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f could not be found. Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Request method failure captured: Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f HTTP/1.1 Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEhfToQOhYXx6oEOkwoFesNMcrzf_q5KwEY1LTHpfeZx0Uw8ovOGB5VRiynxNQfaoty6bUlzGB1egf9LDwTFfxk4kc8yyU-akU_U0g8kc95Ax4luWmbDsi_SAQO4DDZyg3rrMOopsRZTuvELN6zqrlLkO_WjsmKo2on79MDsGT4wGIM Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 64682ed401c74af7aa436a2171819ebe Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1613631908 Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:05:38.400579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64682ed401c74af7aa436a2171819ebe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/64682ed401c74af7aa436a2171819ebe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_64682ed401c74af7aa436a2171819ebe", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/64682ed401c74af7aa436a2171819ebe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesSnapshotTestJSON-1613631908 Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 64682ed401c74af7aa436a2171819ebe Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1613631908 Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesSnapshotTestJSON-1613631908-project Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 1b0423a12e39453e9cd6d1e8ab43af60 Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesSnapshotTestJSON-1613631908-project Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f could not be found. Jun 23 11:05:38.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '5f733e16-e9ed-415a-828c-1e3371b8fb2f'} Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f could not be found. Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:05:38.402598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f could not be found. Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f could not be found. Jun 23 11:05:38.404117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:05:38.405638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] Returning 404 to user: Instance 5f733e16-e9ed-415a-828c-1e3371b8fb2f could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:05:38.405638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0ab9a7d4-d5e3-4fb6-a915-dda24d78e440 tempest-VolumesSnapshotTestJSON-1613631908 tempest-VolumesSnapshotTestJSON-1613631908-project] 10.222.0.65 "GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f" status: 404 len: 111 microversion: 2.1 time: 0.030366 Jun 23 11:05:38.405638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 244/497] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:05:38 2022] GET /compute/v2.1/servers/5f733e16-e9ed-415a-828c-1e3371b8fb2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:05:38.813360 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:38.813959 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:38.820326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:38.820768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:38.821515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:38.821944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:38.948262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:38.958248 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:38.959872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:38.961029 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fb7cc7d-2da9-468c-9578-8b16cf525f60 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.151666 Jun 23 11:05:38.961587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 254/498] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:38 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:39.978845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:39.979451 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:39.986016 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:39.986471 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:39.987237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:39.987690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:40.121800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:40.130086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:40.131578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:40.132744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1ea0644f-b673-4da0-908a-2a8990acdcd4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.157945 Jun 23 11:05:40.133284 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 245/499] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:39 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:41.151179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:41.151817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:41.158478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:41.158928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:41.159717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:41.160152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:41.288051 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:41.295934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:41.297483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:41.298622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b25051c-ce1c-4a63-bc67-c2ddb40a15f0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.152180 Jun 23 11:05:41.299179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 255/500] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:41 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:42.317408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:42.318006 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:42.324578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:42.325019 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:42.325768 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:42.326192 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:42.451390 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:42.459895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:42.461398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:42.462526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e5f5284d-6839-4b5d-b1d9-c32f176b0a38 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.149006 Jun 23 11:05:42.463065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 246/501] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:42 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:43.480625 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:43.481173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:43.487575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:43.488054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:43.488807 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:43.489238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:43.616840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:43.624692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:43.626324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:43.627490 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-de885116-8301-454f-b5ed-04adfbd2d21e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.150880 Jun 23 11:05:43.628330 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 256/502] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:43 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:44.646746 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:44.647256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:44.653878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:44.654321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:44.655084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:44.655513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:44.782648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:44.791196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:44.792752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:44.793897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-65e41aff-7cac-46bc-a27a-1bf043b46d7d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.151133 Jun 23 11:05:44.794449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 247/503] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:44 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:45.812647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:45.813247 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:45.820440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:45.820882 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:45.821629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:45.822053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:45.952879 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:45.961319 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:45.962978 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:45.964478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-323bf4ce-706a-4e7d-87b8-e90ce8909c97 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.155801 Jun 23 11:05:45.965217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 257/504] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:45 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:46.982221 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:46.982896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:46.989378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:46.989817 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:46.990569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:46.990998 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:47.127715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:47.136550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:47.138285 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:47.139567 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fda01ab9-bf42-44fd-841d-eb81f2b9332e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.161202 Jun 23 11:05:47.140142 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 248/505] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:46 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:48.158156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:48.158755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:48.165909 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:48.166352 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:48.167131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:48.167565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:48.296559 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:48.304500 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:48.306035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:48.307166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a6fa406-ce53-44da-9010-a54d04f7d16c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.152927 Jun 23 11:05:48.307738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 258/506] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:48 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:49.324928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:49.325537 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:49.332077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:49.332528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:49.333293 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:49.333728 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:49.462160 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:49.470076 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:49.471588 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:49.472752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2e08963b-428e-467c-a2f5-e54efab3f1eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.151731 Jun 23 11:05:49.473323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 249/507] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:49 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:50.491836 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:50.492375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:50.498819 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:50.499292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:50.500085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:50.500515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:50.521128 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:50.629622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:50.637493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:50.639044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:50.640213 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6e57c8f8-dc0b-45d8-8079-06eb67c55b77 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.152943 Jun 23 11:05:50.640762 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 259/508] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:50 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:51.658375 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:51.658983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:51.665531 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:51.665981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:51.666773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:51.667207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:51.684938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:51.794367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:51.802182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:51.804235 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:51.805449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2a11e720-96b4-44e0-bd2e-197431953811 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.151042 Jun 23 11:05:51.806002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 250/509] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:51 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:52.823721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:52.824332 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:52.830902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:52.831351 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:52.832143 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:52.832578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:52.957529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:52.965866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:52.967397 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:52.968547 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-449b9ba5-d4b5-4a0b-91da-75931a96896b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.148750 Jun 23 11:05:52.969095 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 260/510] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:52 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:53.986291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:53.986899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:53.989227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:53.995503 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:53.995974 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:53.996733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:53.997168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:54.126189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:54.134855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:54.136397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:54.137538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-67e54027-4a8c-4f76-9b21-4422a3ae6874 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.155177 Jun 23 11:05:54.138093 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 251/511] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:53 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:55.155289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:55.156109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:55.162417 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:55.162861 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:55.163619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:55.164073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:55.299598 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:55.307703 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:55.309238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:55.310369 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c719525a-776a-451d-9960-efc81131cc8f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.159150 Jun 23 11:05:55.310911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 261/512] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:55 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:56.328981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:56.329594 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:56.336887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:56.337340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:56.338103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:56.338540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:56.464333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:56.472305 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:56.473812 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:56.475870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9b29c593-101c-479b-81b8-f463b1e53d7c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.150043 Jun 23 11:05:56.476427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 252/513] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:56 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:57.493659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:57.494260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:57.500686 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:57.501122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:57.501873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:57.502305 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:57.627728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:57.635906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:57.637512 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:57.638646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-79da566a-52e4-4e04-b842-4c26749ccfae tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.149489 Jun 23 11:05:57.639223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 262/514] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:57 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:05:58.451514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a58f985-dd17-4534-a548-8a1283ebf4db"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:05:58.452569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:58.458666 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:58.459108 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:58.460525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:58.460953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:58.657377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:58.657988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:58.664865 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:58.665314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:58.666084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:58.666515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:58.760101 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-01aff9f1-4d6f-487a-a050-dfaf9bd63e57 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312331 Jun 23 11:05:58.766387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 253/515] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:05:58 2022] POST /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:05:58.809819 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:58.819888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:58.821488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:58.822839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6caec159-53cb-4d67-bdad-61be4aadef74 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.169576 Jun 23 11:05:58.826424 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 263/516] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:58 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:05:59.842082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:05:59.842790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:05:59.849809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:59.850885 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:59.851614 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:05:59.852082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:05:59.980831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:59.989136 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:59.991315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:05:59.992626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f0fb0115-07d0-4d14-81a2-ca59b3141fff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1741 microversion: 2.20 time: 0.154923 Jun 23 11:05:59.993266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 254/517] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:05:59 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:01.011712 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:01.012310 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:01.014585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=39 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:01.019873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:01.020315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:01.021062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:01.021487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:01.147333 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:01.155312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:01.156887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:01.158024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75fd9f3c-619d-46a8-bf72-3294553dd8e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1741 microversion: 2.20 time: 0.150296 Jun 23 11:06:01.158575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 264/518] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:01 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:02.176515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:02.177127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:02.183957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:02.184407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:02.185169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:02.185604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:02.318787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:02.327295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:02.328830 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:02.329988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c421f7b3-4f6b-47ee-9d1a-e327188d888f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1741 microversion: 2.20 time: 0.157290 Jun 23 11:06:02.330549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 255/519] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:02 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:03.348286 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:03.349220 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:03.357690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:03.358129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:03.358887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:03.359314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:03.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:03.494237 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:03.495822 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:03.496964 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bb1ed3af-9d43-4869-86ea-af103f09cbed tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1741 microversion: 2.20 time: 0.152669 Jun 23 11:06:03.497521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 265/520] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:03 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:04.515640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:04.516353 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:04.523476 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:04.523955 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:04.524720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:04.525154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:04.677224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:04.692057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:04.692057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:04.692057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0a3ead9f-afb8-4b82-b4b9-08db28face7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.176839 Jun 23 11:06:04.692395 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 256/521] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:04 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:05.527418 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-11312dcb-3688-4078-8765-6459dfd72edc req-e8cbb92e-560d-4891-a687-76bae2a85ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "name": "network-vif-plugged", "status": "completed", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:05.536475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-11312dcb-3688-4078-8765-6459dfd72edc req-e8cbb92e-560d-4891-a687-76bae2a85ea5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:05.537037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-11312dcb-3688-4078-8765-6459dfd72edc req-e8cbb92e-560d-4891-a687-76bae2a85ea5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:05.548642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-11312dcb-3688-4078-8765-6459dfd72edc req-e8cbb92e-560d-4891-a687-76bae2a85ea5 service nova] Creating event network-vif-plugged:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:06:05.554341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-11312dcb-3688-4078-8765-6459dfd72edc req-e8cbb92e-560d-4891-a687-76bae2a85ea5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030314 Jun 23 11:06:05.554997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 266/522] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:06:05.708360 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:05.709667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:05.716747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:05.717200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:05.718155 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:05.718596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:05.911405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:05.920843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:05.922411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:05.923649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4e2f247e-314d-4d5f-b9f0-297d14e66212 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.221249 Jun 23 11:06:05.935318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 257/523] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:05 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:06.944202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:06.945560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:06.952111 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:06.952643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:06.953470 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:06.953988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:07.103494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:07.112414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:07.114885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:07.118221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-54c9cf33-aec6-4013-ac19-77ce3a116645 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.179281 Jun 23 11:06:07.119138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 267/524] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:06 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:07.380354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:07.381376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:07.388700 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:07.389144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:07.390092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:07.390525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:07.415830 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lazy-loading 'flavor' on Instance uuid ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:06:07.563193 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-16b5b07c-63e3-40a6-bfc2-559964a72ff4 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/action" status: 200 len: 32 microversion: 2.1 time: 0.186996 Jun 23 11:06:07.564063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 258/525] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:06:07 2022] POST /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:06:07.573944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:07.574769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:07.585459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:07.587462 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:07.592167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:07.592297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:07.827516 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:07.837452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b1d7f95f-b8d5-470b-a862-55b663566c0b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.267774 Jun 23 11:06:07.838370 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 268/526] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:07 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:08.142481 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:08.145991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:08.158556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:08.161307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:08.164131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:08.165469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:08.403823 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:08.417190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:08.418878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:08.420119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cc059728-3823-4607-bbee-2b4bcbd9b797 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.286288 Jun 23 11:06:08.420875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 259/527] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:08 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:08.854966 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:08.855684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:08.862503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:08.863213 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:08.864045 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:08.864645 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:09.018874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:09.027901 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65540cef-8858-42eb-9e1e-51eb02826f4f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.176837 Jun 23 11:06:09.029393 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 269/528] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:08 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:09.439808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:09.441471 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:09.448963 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:09.449737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:09.450687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:09.451526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:09.720711 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:09.730357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:09.732307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:09.734141 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2aabbeef-71d3-476e-9d10-91bacfe4f237 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.298215 Jun 23 11:06:09.748771 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 260/529] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:09 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:10.045832 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:10.046443 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:10.054834 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:10.055643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:10.056753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:10.057517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:10.260324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:10.271468 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-eeff3702-5e2d-480b-8d54-130255f0ac72 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.229429 Jun 23 11:06:10.276637 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 270/530] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:10 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:10.753991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:10.755042 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:10.761970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:10.762920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:10.763978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:10.764631 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:10.928923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:10.937297 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:10.939114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:10.940543 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-41696ead-01bb-478d-b4a2-93694e0a6281 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.190588 Jun 23 11:06:10.941444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 261/531] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:10 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:11.293633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:11.294391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:11.309846 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:11.310398 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:11.311419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:11.312140 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:11.448292 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:11.456859 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6e116aec-286d-4eac-86b4-940a33194a1c tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.167171 Jun 23 11:06:11.457419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 271/532] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:11 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:11.960986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:11.961677 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:11.968773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:11.969223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:11.970031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:11.970463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:12.126884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:12.135897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:12.137751 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:12.139140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1d51c171-baf8-47a9-8d70-365df6d6832f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.182800 Jun 23 11:06:12.139928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 262/533] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:11 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:12.474533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:12.475459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:12.482272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:12.482685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:12.483708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:12.484287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:12.635519 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:12.643628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ce8bcc3d-680b-4150-bc5a-aa349f282238 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.173312 Jun 23 11:06:12.657105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 272/534] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:12 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:13.158222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:13.159829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:13.166687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:13.167402 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:13.168397 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:13.169203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:13.319751 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:13.323728 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:13.329411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:13.330986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:13.332239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-81d47a84-8719-4500-b758-415732f9a6e5 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.177985 Jun 23 11:06:13.332820 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 263/535] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:13 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:13.665563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:13.666320 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:13.673192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:13.673874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:13.674641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:13.676602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:13.818304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:13.827280 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-309efcaf-0f43-43de-8037-60c6b622e087 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.165801 Jun 23 11:06:13.828324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 273/536] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:13 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:14.352680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:14.353229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:14.360533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:14.360979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:14.361741 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:14.362177 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:14.487434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:14.495477 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:14.497653 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:14.498785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8b7bce85-812d-40c9-ab7a-fc55b7fe91c2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1736 microversion: 2.20 time: 0.151178 Jun 23 11:06:14.499331 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 264/537] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:14 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:14.844354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:14.844984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:14.851390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:14.851865 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:14.852610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:14.853034 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:14.981272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:14.989165 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7da5ff4d-7431-4a8d-8210-f484c7309429 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.148681 Jun 23 11:06:14.989716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 274/538] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:14 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:15.518056 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:15.519432 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:15.525485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:15.525942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:15.526708 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:15.527173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:15.657794 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:15.666366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:15.667900 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:15.669071 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c5f790ba-c493-491c-ac58-56d5d9a7ecad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1718 microversion: 2.20 time: 0.155813 Jun 23 11:06:15.669624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 265/539] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:15 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:16.007469 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:16.008078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:16.014428 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.014877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.015629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.016088 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.090451 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:16.090911 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:16.097143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.097591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.098640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.098783 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.122624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0b01103b-3a5b-451f-b976-41fd8f7724bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/ips" status: 200 len: 150 microversion: 2.1 time: 0.035983 Jun 23 11:06:16.123195 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 266/540] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:06:16 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:06:16.133383 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3de9a110-0a72-4fa4-9e53-ada4db1c82a7"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:16.134431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:16.140276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.140724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.141485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.141918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.142083 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:16.150228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e2f7d5b3-b78c-4ec2-ad46-8b1f2043edce tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.147331 Jun 23 11:06:16.150787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 275/541] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:16 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:16.218683 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Invalid volume: volume 3de9a110-0a72-4fa4-9e53-ada4db1c82a7 is already attached to instances: 2946bfb4-cd02-4237-8291-ad974a96ded6 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: POST /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/os-volume_attachments HTTP/1.1 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 74 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:06:16.220456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {"volumeAttachment": {"volumeId": "3de9a110-0a72-4fa4-9e53-ada4db1c82a7"}} Jun 23 11:06:16.222077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Invalid volume: volume 3de9a110-0a72-4fa4-9e53-ada4db1c82a7 is already attached to instances: 2946bfb4-cd02-4237-8291-ad974a96ded6 Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'server_id': '6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5', 'body': {'volumeAttachment': {'volumeId': '3de9a110-0a72-4fa4-9e53-ada4db1c82a7'}}} Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3de9a110-0a72-4fa4-9e53-ada4db1c82a7 is already attached to instances: 2946bfb4-cd02-4237-8291-ad974a96ded6 Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:16.222966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3de9a110-0a72-4fa4-9e53-ada4db1c82a7 is already attached to instances: 2946bfb4-cd02-4237-8291-ad974a96ded6 Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:16.224163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3de9a110-0a72-4fa4-9e53-ada4db1c82a7 is already attached to instances: 2946bfb4-cd02-4237-8291-ad974a96ded6 Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 400 to user: Invalid volume: volume 3de9a110-0a72-4fa4-9e53-ada4db1c82a7 is already attached to instances: 2946bfb4-cd02-4237-8291-ad974a96ded6 {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-90914860-8d24-4d04-8fba-66bdbbe2d91c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092480 Jun 23 11:06:16.225333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 267/542] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:06:16 2022] POST /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 11:06:16.230903 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:16.231393 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:16.237276 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.237714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.238461 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.238887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.264019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:06:16.266782 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:16.335766 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-68e8f8d6-e441-41d5-90b6-e70b70fd7b0a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 204 len: 0 microversion: 2.1 time: 0.108634 Jun 23 11:06:16.336628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 276/543] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:06:16 2022] DELETE /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:06:16.344913 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:16.345523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:16.352200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.352643 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.353398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.353834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.478584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:16.486410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-942db656-813c-4748-978d-fc3b8999bc09 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1681 microversion: 2.1 time: 0.145679 Jun 23 11:06:16.486958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 268/544] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:16 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:16.688838 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:16.689459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:16.695442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.695928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.696717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:16.697152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:16.825098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:16.833060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:16.834611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:16.836277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a719bd29-b0bb-41f0-b831-019c775f43bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1718 microversion: 2.20 time: 0.151871 Jun 23 11:06:16.836837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 277/545] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:16 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:17.167299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:17.167939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:17.174454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:17.174914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:17.175685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:17.176131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:17.300092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:17.308735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2b46f84f-a14b-4cd5-b1a3-9b589b045712 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.145336 Jun 23 11:06:17.309287 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 269/546] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:17 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:17.505021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:17.505619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:17.512553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:17.512997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:17.513750 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:17.514181 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:17.642824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:17.650196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c600774-4ca4-4510-a85c-4ec8d4d5d87c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1681 microversion: 2.1 time: 0.149343 Jun 23 11:06:17.650765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 278/547] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:17 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:17.854341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:17.854942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:17.861108 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:17.861549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:17.862298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:17.862724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:17.991053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:17.998816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:18.000353 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:18.001489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-59bfe4de-8b32-42d3-ac10-0ab1f728ee13 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1718 microversion: 2.20 time: 0.151554 Jun 23 11:06:18.002032 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 270/548] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:17 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:18.326272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:18.326872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:18.332844 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:18.333281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:18.334023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:18.334448 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:18.458453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:18.466807 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc7ca2f8-02bd-4e99-ae26-a467c61fa93b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.144344 Jun 23 11:06:18.467354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 279/549] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:18 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:18.666754 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:18.667365 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:18.673843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:18.674291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:18.675052 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:18.675515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:18.800720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:18.808126 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-62e1a6f5-77e8-41ac-8133-b51041e23d38 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1681 microversion: 2.1 time: 0.145792 Jun 23 11:06:18.808687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 271/550] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:18 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:19.021061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:19.021664 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:19.028639 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.029085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.029837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.030270 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.159760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:19.167745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:19.169290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:19.170426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f2dc1cc3-b674-488b-8d56-2057fa7babf9 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1718 microversion: 2.20 time: 0.153288 Jun 23 11:06:19.170979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 280/551] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:19 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:19.484553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:19.485151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:19.491496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.491975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.493256 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.493698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.496315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-7b77bc15-44fd-45d4-8eed-1f3305d3214c req-6f89a121-1b57-41d9-9b44-24b11a62ea17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "name": "network-vif-unplugged", "status": "completed", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:19.505153 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7b77bc15-44fd-45d4-8eed-1f3305d3214c req-6f89a121-1b57-41d9-9b44-24b11a62ea17 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.505592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-7b77bc15-44fd-45d4-8eed-1f3305d3214c req-6f89a121-1b57-41d9-9b44-24b11a62ea17 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.518167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-7b77bc15-44fd-45d4-8eed-1f3305d3214c req-6f89a121-1b57-41d9-9b44-24b11a62ea17 service nova] Creating event network-vif-unplugged:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:06:19.523130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-7b77bc15-44fd-45d4-8eed-1f3305d3214c req-6f89a121-1b57-41d9-9b44-24b11a62ea17 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030931 Jun 23 11:06:19.523828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 281/552] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:06:19.634018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:19.642223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-46dda574-d59b-42ae-833f-5ef7a0b57855 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.162316 Jun 23 11:06:19.642800 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 272/553] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:19 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:19.826325 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:19.827011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:19.833196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.833634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.834381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:19.834804 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:19.964941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:19.972415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9b8a122b-dc55-451d-a7b4-e3f5cc598441 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1681 microversion: 2.1 time: 0.150447 Jun 23 11:06:19.972980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 282/554] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:19 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:20.188574 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:20.189839 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:20.196922 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.197662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.198440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.198882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.451277 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:20.459424 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:20.461137 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:20.462678 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2a380197-4d1d-4754-9fee-90ed6b12e719 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1661 microversion: 2.20 time: 0.278311 Jun 23 11:06:20.463234 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 273/555] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:20 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1661 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:20.480952 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b5d63bd-22b7-46a4-ad4c-257746d99aec"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:20.482182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:20.488741 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.489169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.489930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.490359 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.659984 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:20.660821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:20.667286 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.667875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.668533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.669267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.788438 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f57c6b17-ee7f-4502-a004-383c5ef31626 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311755 Jun 23 11:06:20.789142 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 283/556] 10.222.0.65 () {62 vars in 1363 bytes} [Thu Jun 23 11:06:20 2022] POST /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:06:20.875906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:20.886030 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ca2e9daa-07ca-4adb-868d-9161520b6862 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.230060 Jun 23 11:06:20.886803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 274/557] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:20 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:20.916951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:20.917636 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:20.925235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.925777 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.926796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:20.927433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:20.990342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:20.990953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:21.005552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.006299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:21.007096 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.007626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:21.062037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-865aaba2-8e42-4b28-ba75-a859e4db4dad tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/action" status: 202 len: 0 microversion: 2.20 time: 0.149376 Jun 23 11:06:21.066874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 284/558] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Jun 23 11:06:20 2022] POST /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:06:21.075335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-2d5121c9-2301-4977-929c-d3d6c88fc3f9 req-a9e8f556-38bc-4635-99bc-702f60ed0473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5", "name": "network-vif-deleted", "tag": "b7535b31-8d71-494f-97b9-054dc6058267"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:21.099240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-2d5121c9-2301-4977-929c-d3d6c88fc3f9 req-a9e8f556-38bc-4635-99bc-702f60ed0473 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.099240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-2d5121c9-2301-4977-929c-d3d6c88fc3f9 req-a9e8f556-38bc-4635-99bc-702f60ed0473 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:21.122513 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-2d5121c9-2301-4977-929c-d3d6c88fc3f9 req-a9e8f556-38bc-4635-99bc-702f60ed0473 service nova] Creating event network-vif-deleted:b7535b31-8d71-494f-97b9-054dc6058267 for instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 on hv-cinder-84330 Jun 23 11:06:21.149552 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-2d5121c9-2301-4977-929c-d3d6c88fc3f9 req-a9e8f556-38bc-4635-99bc-702f60ed0473 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080152 Jun 23 11:06:21.151673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 285/559] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:21.161584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:21.162483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:21.170328 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.170912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:21.172249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.172576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:21.344659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:21.355215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:21.358481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:21.359926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-56eaa9ad-0cef-423e-b8dd-a203a771457d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1747 microversion: 2.20 time: 0.206784 Jun 23 11:06:21.360649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 286/560] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:21 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1747 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:21.464058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:21.474120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b6bded4e-461c-4fd9-acfe-fea93fb2cedc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 200 len: 1614 microversion: 2.1 time: 0.487406 Jun 23 11:06:21.475698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 275/561] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:20 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 1614 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:21.913269 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:21.917458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:21.925030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.925492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:21.926543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:21.926990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:22.117676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:22.127014 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39e35ef9-cc1a-4b3d-8e10-4f184d7c7cb1 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.225427 Jun 23 11:06:22.127014 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 287/562] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:21 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:22.380528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:22.381458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:22.389637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:22.390083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:22.390844 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:22.391450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:22.497534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:22.503195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:22.512713 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:22.513322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:22.514184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:22.514715 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:22.531361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 HTTP/1.1 Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:06:22.533185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:06:22.534487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5'} Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:06:22.535231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:06:22.537218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:22.539009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:06:22.539009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b826101-4e71-4185-87a7-46ecae64ba37 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 404 len: 111 microversion: 2.1 time: 0.044951 Jun 23 11:06:22.539009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 288/563] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:22 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:06:22.544241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ce205a4f-8150-4162-b2b2-bc7376e5d034 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '.version_select at 0x7f089c879c10>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:22.551391 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:22.560758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:22.562219 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:22.563647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ed03c4be-7cd4-4ec7-ae20-7e78546cecab tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1747 microversion: 2.20 time: 0.187487 Jun 23 11:06:22.564225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 276/564] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:22 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1747 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:22.564586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ce205a4f-8150-4162-b2b2-bc7376e5d034 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818101925" status: 202 len: 0 microversion: 2.1 time: 0.024779 Jun 23 11:06:22.568635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 289/565] 10.222.0.65 () {58 vars in 1217 bytes} [Thu Jun 23 11:06:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818101925 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:06:23.145636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:23.146855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:23.154956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.155418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.156263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.156707 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.247562 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:23.248053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:23.255445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.255928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.256696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.257130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.303804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:23.312974 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-48297937-6a90-4ae6-8ff6-ab315333312d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.171238 Jun 23 11:06:23.313541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 277/566] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:23 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:23.337312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lazy-loading 'services' on Instance uuid 2946bfb4-cd02-4237-8291-ad974a96ded6 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:06:23.340730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:23.410553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2dbc5ac1-9d8a-4f46-8b30-6f433be29ad4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments/3de9a110-0a72-4fa4-9e53-ada4db1c82a7" status: 202 len: 0 microversion: 2.1 time: 0.167959 Jun 23 11:06:23.411138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 290/567] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:06:23 2022] DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments/3de9a110-0a72-4fa4-9e53-ada4db1c82a7 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:06:23.420207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:23.421236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:23.428712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.429163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.430550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.430996 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.464183 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b89a992e-0fda-4fbb-96ee-153fa34bc0c1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048387 Jun 23 11:06:23.468337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 278/568] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:06:23 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:23.583080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:23.583731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:23.589960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.590400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.591146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:23.591568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:23.720777 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:23.729647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:23.731177 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:23.732336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97ec342d-ee1e-4e64-9880-b554b57797d7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1749 microversion: 2.20 time: 0.153654 Jun 23 11:06:23.732878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 291/569] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:23 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:24.329767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:24.330377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:24.332232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=56 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:24.338197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.338652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.339418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.339884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.473431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:24.475507 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:24.476607 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:24.481608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f5ad3f2e-30e6-4b76-b273-7c3c9fc26adb tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.155598 Jun 23 11:06:24.482169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 279/570] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:24 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:24.483071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.483539 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.484337 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.484771 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.516906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f77512f-8fd7-4eb6-8078-90fab151c4dc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045289 Jun 23 11:06:24.517464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 292/571] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:06:24 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:06:24.581951 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:24.588179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:24.594264 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.594909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.595896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.596496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.621311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:06:24.624263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:24.696493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9db99bdd-2680-4003-853e-80a900106efc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 204 len: 0 microversion: 2.1 time: 0.117585 Jun 23 11:06:24.697057 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 280/572] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:06:24 2022] DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:06:24.705102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:24.705708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:24.711681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.712651 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.713404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.713829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.752550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:24.753265 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:24.760157 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.760607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.761368 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:24.761795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:24.839944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:24.847779 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99376269-dd26-4d47-8695-81a1c21907bb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1681 microversion: 2.1 time: 0.146491 Jun 23 11:06:24.848428 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 293/573] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:24 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:24.893859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:24.902838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:24.904384 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:24.905643 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-99cc9c07-22f6-4362-ad74-5fa338a8e59a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.157342 Jun 23 11:06:24.906187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 281/574] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:24 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:25.442537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:25.442925 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:25.449280 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.449725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.450496 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.450927 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.498040 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:25.498646 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:25.505424 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.505872 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.506637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.507075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.534034 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lazy-loading 'services' on Instance uuid 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:06:25.613404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-61f79738-49be-46b9-a966-e289fe630b9c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-volume_attachments/43154e8d-79e4-47a5-b097-16c39438daac" status: 202 len: 0 microversion: 2.1 time: 0.174928 Jun 23 11:06:25.617695 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 294/575] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:06:25 2022] DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-volume_attachments/43154e8d-79e4-47a5-b097-16c39438daac => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:06:25.717059 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:25.725012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-206a015c-0535-422f-aa15-eb8df1378737 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.230797 Jun 23 11:06:25.725572 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 282/576] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:25 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:25.865668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:25.866363 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:25.872633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.873074 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.873825 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.874254 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.923990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:25.924596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:25.930671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.931123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:25.931916 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:25.932352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:26.004280 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:26.014895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-adf0e2a0-92cf-420b-be8f-b9d037ab8860 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1681 microversion: 2.1 time: 0.153467 Jun 23 11:06:26.015560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 295/577] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:25 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:26.059631 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:26.068121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:26.069630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:26.071306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7930ba19-dc76-4db7-b4df-f4f7295eca9d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.150735 Jun 23 11:06:26.071885 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 283/578] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:25 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:26.742121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:26.743381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:26.749850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:26.750294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:26.751035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:26.751462 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:26.874136 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:26.882179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7cba13a-2641-4b81-bca0-4aef03c33018 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.143902 Jun 23 11:06:26.882732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 296/579] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:26 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:27.032299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:27.032915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:27.041410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:27.041862 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:27.042624 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:27.043056 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:27.089374 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:27.090085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:27.096176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:27.096716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:27.097557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:27.098069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:27.205453 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:27.213475 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fa9742e9-bb8a-4ded-b526-c5afaed68b70 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1681 microversion: 2.1 time: 0.184947 Jun 23 11:06:27.214125 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 284/580] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:27 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:27.243219 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:27.251516 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:27.253094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:27.254228 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d9669f47-c16b-40dc-8ee4-49ceb76d8baa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.169324 Jun 23 11:06:27.254777 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 297/581] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:27 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:27.898492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:27.899027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:27.905232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:27.905682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:27.906444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:27.906878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.095835 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:28.107796 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2f411e37-1034-4ee7-be1b-3dd526b4e972 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.212984 Jun 23 11:06:28.108602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 285/582] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:27 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:28.230900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:28.231502 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:28.237959 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.238405 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.239154 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.239579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.272442 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:28.273139 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:28.279132 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.279672 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.280511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.281017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.423445 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:28.432526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:28.434083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:28.435473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b7e10276-77b1-47d4-b899-a7e57dd1cfe1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.166820 Jun 23 11:06:28.436129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 286/583] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:28 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:28.482452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:28.489873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f9cf448d-0159-4c2a-a70d-b4f1faed5c14 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1681 microversion: 2.1 time: 0.263467 Jun 23 11:06:28.490436 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 298/584] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:28 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:28.833184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-45f5b202-62dc-4c4b-abc1-d15dcb49f6d7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:28.840088 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-45f5b202-62dc-4c4b-abc1-d15dcb49f6d7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.840540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-45f5b202-62dc-4c4b-abc1-d15dcb49f6d7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.865381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-45f5b202-62dc-4c4b-abc1-d15dcb49f6d7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Going to try to stop instance {{(pid=117878) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:06:28.917901 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-45f5b202-62dc-4c4b-abc1-d15dcb49f6d7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action" status: 202 len: 0 microversion: 2.1 time: 0.088628 Jun 23 11:06:28.922090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 287/585] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:06:28 2022] POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:06:28.926947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:28.927643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:28.946192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.946797 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:28.947675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:28.948706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.135327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:29.137857 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:29.151553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.153045 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.154026 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.154873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.437173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:29.445813 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:29.453640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-39421994-440c-45ee-a672-eded13f6f4a0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.527859 Jun 23 11:06:29.455085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 299/586] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:28 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:29.468312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d45b4a23-7382-4523-b8a3-f3fda2726596 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.342968 Jun 23 11:06:29.468934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 288/587] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:29 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:29.474932 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:29.480864 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:29.493665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.493856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-589a349b-c8ef-4a1b-ba39-a6b53119f7b5 req-1e1f2f72-10ca-4e32-9b2b-cb688afc7ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2946bfb4-cd02-4237-8291-ad974a96ded6", "name": "network-vif-deleted", "tag": "7c27c36f-56fd-4d7b-b077-2903298e9c9c"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:29.494491 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.495453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.496081 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.503402 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-589a349b-c8ef-4a1b-ba39-a6b53119f7b5 req-1e1f2f72-10ca-4e32-9b2b-cb688afc7ca6 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.510454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-589a349b-c8ef-4a1b-ba39-a6b53119f7b5 req-1e1f2f72-10ca-4e32-9b2b-cb688afc7ca6 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.549856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-589a349b-c8ef-4a1b-ba39-a6b53119f7b5 req-1e1f2f72-10ca-4e32-9b2b-cb688afc7ca6 service nova] Creating event network-vif-deleted:7c27c36f-56fd-4d7b-b077-2903298e9c9c for instance 2946bfb4-cd02-4237-8291-ad974a96ded6 on hv-cinder-84330 Jun 23 11:06:29.561506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-589a349b-c8ef-4a1b-ba39-a6b53119f7b5 req-1e1f2f72-10ca-4e32-9b2b-cb688afc7ca6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071229 Jun 23 11:06:29.564372 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 289/588] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:06:29.582215 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:29.583239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:29.598463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.600167 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.601834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:29.608286 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:29.721810 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:29.730150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-14c37f31-9b52-4bc5-b406-a50e0836b17d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.164478 Jun 23 11:06:29.733825 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:29.740417 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 290/589] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:29 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:29.743514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:29.751114 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:29.752421 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-18395e72-c5f5-4018-8a50-ef8431d866f6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.284019 Jun 23 11:06:29.753170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 300/590] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:29 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:30.472726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:30.473415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:30.480931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.481459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.482290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.482928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.485101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:30.486082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:30.492091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.492662 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.493948 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.494383 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.647962 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:30.653031 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:30.656779 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3a9bf5b4-fc89-469d-8854-fafae9d03576 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.188455 Jun 23 11:06:30.661771 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f1dc138-465f-4d53-86c3-3198a76b3c25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.180510 Jun 23 11:06:30.667838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 291/591] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:30 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:30.668415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 301/592] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:30 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:30.747076 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:30.747985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:30.755612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.756115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.756967 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.757422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.772456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:30.773347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:30.782106 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.791454 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.792562 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:30.793163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:30.855514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:30.864493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7ffdd722-b92b-4fde-a452-ea1ed830aae5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.120954 Jun 23 11:06:30.865387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 292/593] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:30 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:30.932287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:30.940749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:30.942304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:30.943440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-48e50c55-b849-48fb-a57a-77fa9a11b3d8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.175295 Jun 23 11:06:30.944032 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 302/594] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:30 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:31.674384 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:31.675757 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:31.679227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:31.679866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:31.682869 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:31.684398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.684813 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.685581 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.686007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.688658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.689102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.689866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.690294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.816254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:31.824022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:31.824979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bb52dc1e-63f6-4091-a5b8-571cf9ba361c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.154504 Jun 23 11:06:31.825545 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 293/595] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:31 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:31.835315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-059fdf3c-db04-40ff-ba38-5ceadf5abb92 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.159832 Jun 23 11:06:31.836223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 303/596] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:31 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:31.881228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:31.881833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:31.887873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.888326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.889109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.889539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.954428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:31.961395 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:31.962003 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:31.962226 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-67758bd5-64ac-4235-a49b-5f7f9cd22a4f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.085021 Jun 23 11:06:31.962777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 294/597] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:31 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:31.968482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.969121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:31.970034 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:31.970469 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:32.123916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:32.132638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:32.134208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:32.135347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ea5380c-8c98-4401-83f6-5c2d011a19ff tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.178034 Jun 23 11:06:32.135938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 304/598] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:31 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:32.843437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:32.844077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:32.850542 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:32.850989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:32.851774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:32.852258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:32.852445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:32.853054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:32.859422 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:32.859904 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:32.860671 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:32.861101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:32.869959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:32.989082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:32.999014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-32d86196-cbbb-49f5-be1b-8229bc275e5f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.159334 Jun 23 11:06:33.002949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:33.011275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 295/599] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:32 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:33.013004 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8b47c8f2-8de8-4ea8-ac5c-0cc7cde87023 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.164351 Jun 23 11:06:33.014135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 305/600] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:32 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:33.027127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:33.027856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:33.036248 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:33.036691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:33.037560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:33.038074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:33.107210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:33.114744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7c5f4aff-2cfd-4faf-ad07-37f90072c208 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.102309 Jun 23 11:06:33.115301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 296/601] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:33 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:33.153702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:33.154311 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:33.160357 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:33.160800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:33.161581 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:33.162017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:33.179902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:33.287942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:33.296569 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:33.298090 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:33.299473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cc8562c2-4ca0-477e-b3ef-d5ffd337dcba tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.150007 Jun 23 11:06:33.300061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 306/602] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:33 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:34.017629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:34.018238 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:34.024812 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.025584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.026364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.026802 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.030937 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:34.031646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:34.041072 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.042787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.043836 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.044282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.162714 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:34.170852 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6535e29e-1ed6-455a-92f1-9e1862f01b75 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.157052 Jun 23 11:06:34.171411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 297/603] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:34 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:34.173083 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:34.176006 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:34.176729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:34.181782 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9b868ad8-b2bf-4b83-b99d-ce747a4387a7 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.155200 Jun 23 11:06:34.182340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 307/604] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:34 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:34.183150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.183632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.184429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.184866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.245103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:34.252596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5cb844b8-35a7-4ba2-bcb8-0f5987c0d1cd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.080201 Jun 23 11:06:34.253176 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 298/605] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:34 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:34.318321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:34.318961 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:34.325015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.325461 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.326225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:34.326660 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:34.454191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:34.463001 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:34.464579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:34.465724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c7f9b998-391e-4146-a5e8-ae657bde4b54 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.151326 Jun 23 11:06:34.466283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 308/606] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:34 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:35.189339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:35.190613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:35.200307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:35.201003 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:35.209098 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.212852 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.213399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.213958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.214875 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.215773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.216267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.216760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.348243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:35.348962 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:35.355924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-992276f9-6f1a-4663-8609-084ade156521 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.171365 Jun 23 11:06:35.356422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 299/607] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:35 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:35.356989 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e7769f5-9c60-4a37-81b2-ba6d2b4b19d0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.161352 Jun 23 11:06:35.357626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 309/608] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:35 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:35.361140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:35.361860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:35.368211 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.368610 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.369373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.369807 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.433363 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:35.440811 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-958d4d82-cfd1-46dd-a4b6-168b88a3c0d3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.083459 Jun 23 11:06:35.441369 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 300/609] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:35 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:35.483847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:35.484449 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:35.490823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.491274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.492055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:35.492488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:35.624120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:35.632835 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:35.634622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:35.635917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-75b2f11f-afea-4e0b-8bb2-19364efe0ae1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.155964 Jun 23 11:06:35.636885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 310/610] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:35 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:36.376496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:36.377066 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:36.377680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:36.377784 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:36.384908 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.385356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.385477 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.385872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.386515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.386627 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.386956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.387057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.538632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:36.550865 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1544f615-15d1-4fb9-b9bd-b6f400168571 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.179448 Jun 23 11:06:36.551462 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 311/611] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:36 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:36.556465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:36.563887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:36.564513 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:36.567364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6e61f500-0f13-4b0d-a28f-1d34f0586143 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.197607 Jun 23 11:06:36.569014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 301/612] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:36 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:36.579573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.580098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.580887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.581317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.645413 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:36.654628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49a0c5ff-c075-42f9-82ef-9d1824c305f4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.100315 Jun 23 11:06:36.655351 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 312/613] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:36 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:36.658367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:36.658367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:36.663630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.664185 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.665005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:36.665458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:36.816069 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:36.825605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:36.827109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:36.828295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1887c559-67f1-49c5-a27f-fc11016c2715 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.176092 Jun 23 11:06:36.828845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 302/614] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:36 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:37.567989 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:37.568604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:37.575728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.576179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.576933 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.577372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.585621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:37.586226 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:37.592652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.593093 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.593848 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.594275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.736085 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:37.746052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-abbe8aca-2f41-4618-b49f-c2f3d30a4748 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.182012 Jun 23 11:06:37.747940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 313/615] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:37 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:37.754436 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:37.755310 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:37.762747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.763446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.765004 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.765609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.773546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:37.782071 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-66db68da-6039-4214-9580-54a02ae3f544 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.200234 Jun 23 11:06:37.782887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 303/616] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:37 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:37.833778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:37.841647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-91951790-6673-40c5-a83a-3a83bced48be tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.092433 Jun 23 11:06:37.842208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 314/617] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:37 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:37.846367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:37.846983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:37.852954 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.853415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.854169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:37.854606 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:37.979898 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:37.988187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:37.989698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:37.990838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-88a6de28-ff6b-460f-9b71-44bf6f757939 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.148287 Jun 23 11:06:37.991421 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 304/618] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:37 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:38.764451 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:38.765057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:38.771493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:38.772024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:38.772813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:38.773244 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:38.800031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:38.800698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:38.807866 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:38.808322 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:38.809108 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:38.809533 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:38.936487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:38.944682 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4f1e386-917a-40b4-83f6-da556f673a5d tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.184017 Jun 23 11:06:38.945634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 315/619] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:38 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:38.956073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:38.956914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:38.963560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:38.963995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:38.964736 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:38.965210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:38.976702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:38.987977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5de1246c-6bd8-4c61-b2e4-b0089d2e5e2b tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.191077 Jun 23 11:06:38.989553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 305/620] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:38 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:39.009582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:39.010783 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:39.017106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:39.017552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:39.018500 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:39.018941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:39.038361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:39.045859 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3545ff13-a0d3-498d-8abf-233a01430855 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.099159 Jun 23 11:06:39.046423 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 316/621] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:38 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:39.145494 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:39.153850 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:39.155379 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:39.156541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5e24ae88-d8da-4ce3-8244-eeaf3b401b2e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.151317 Jun 23 11:06:39.157102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 306/622] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:39 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:39.963378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:39.964173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:39.970583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:39.971021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:39.971809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:39.972233 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.006285 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:40.006895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:40.013438 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:40.013888 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.014667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:40.015103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.101978 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:40.110133 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-26e42309-0a2f-4214-8423-1159508dd229 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.152177 Jun 23 11:06:40.110699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 317/623] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:39 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:40.115032 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:40.115638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:40.121431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:40.121874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.122659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:40.123058 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.154787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:40.162288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fc0ab427-6486-40e7-b8b7-fe9b894c24f9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.160139 Jun 23 11:06:40.163090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 307/624] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:40 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:40.174207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:40.174826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:40.181915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:40.182362 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.183449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:40.183918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:40.186423 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:40.194885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-25f7ba39-4fd3-44b5-9851-05062fdacf43 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.083161 Jun 23 11:06:40.195685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 318/625] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:40 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:40.328121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:40.336487 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:40.338565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:40.339742 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f53dbb0e-1344-4246-92f7-a9e8c661e90c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.169411 Jun 23 11:06:40.340301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 308/626] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:40 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:41.127175 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:41.127991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:41.135206 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.135692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.136992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.136992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.179336 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:41.180225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:41.189719 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.196274 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.197303 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.197764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.299732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:41.308353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bc4495d5-ca39-466d-af91-4949b277d9fc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.185130 Jun 23 11:06:41.308926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 319/627] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:41 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:41.313412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:41.314011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:41.319950 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.320403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.321170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.321602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.342130 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:41.350669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6a517c5e-a0be-4793-ab18-1b402fd4d173 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.174877 Jun 23 11:06:41.351154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 309/628] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:41 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:41.359183 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:41.359995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:41.371679 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.372233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.373323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:41.373984 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:41.399038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:41.410060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9fff7f52-deeb-4aaf-a21c-2af2b2bd6782 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.100075 Jun 23 11:06:41.421079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 320/629] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:41 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:41.531783 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:41.540164 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:41.542387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:41.543529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2f6dbdea-88eb-440e-b4ca-c8f9bea1da46 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.188711 Jun 23 11:06:41.544115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 310/630] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:41 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:42.325372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:42.326017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:42.332595 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.333045 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.333803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.334240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.370795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:42.371485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:42.377996 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.378437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.379204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.379632 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.464403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:42.472747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ebab8ccb-f106-4f34-9852-bd98195c9501 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1732 microversion: 2.1 time: 0.151184 Jun 23 11:06:42.473316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 321/631] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:42 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:42.478039 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:42.479227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:42.485098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.485540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.486302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.486756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.508552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:42.516561 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1c7f21f5-5a29-4e6f-b66e-da033700fd26 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.150217 Jun 23 11:06:42.517125 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 311/632] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:42 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:42.550249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:42.558251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-348041de-2649-4e7a-8290-022481229bee tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1613 microversion: 2.1 time: 0.084005 Jun 23 11:06:42.558799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 322/633] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:42 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:42.562246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:42.562833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:42.568795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.569243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.569997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:42.570456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:42.574352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:42.698584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:42.707015 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:42.708524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:42.709669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-68187c0e-a7bf-416a-9887-ede3a3150feb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.151297 Jun 23 11:06:42.710226 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 312/634] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:42 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:43.490357 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:43.490897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.497867 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.498316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.499076 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.499521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.503482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:43.533453 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:43.534061 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.540639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.541088 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.541852 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.542288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.627368 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:43.636246 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-aa569d05-c8b9-4895-94b5-24c3e862f9cf tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1712 microversion: 2.1 time: 0.149874 Jun 23 11:06:43.636811 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 323/635] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:43 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1712 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:43.641258 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:43.641865 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.647676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.648156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.648925 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.649372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.672598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:43.680745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3b30ee69-3094-4cdb-8c89-e45a5b61de25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.151037 Jun 23 11:06:43.689086 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.689528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.689967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lazy-loading 'fault' on Instance uuid 2946bfb4-cd02-4237-8291-ad974a96ded6 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:06:43.691348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 313/636] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:43 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:43.729264 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:43.729903 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.730467 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:43.738548 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8c8f8bdc-c53c-4dbe-8e69-130708c1c29e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 200 len: 1331 microversion: 2.1 time: 0.100750 Jun 23 11:06:43.739186 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 324/637] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:43 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:43.740235 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.740851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.741577 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.742016 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.744673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:43.745223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.750981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.751498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.752370 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.752873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.832059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] HTTP exception thrown: Cannot 'detach_volume' instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 while it is in vm_state rescued Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Request method failure captured: Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments/6a58f985-dd17-4534-a548-8a1283ebf4db HTTP/1.1 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEg3iINLTSjOhWRw2HyLGSvSdbOBEFBaAq4FQvIugZYQsYteQvjoiPUsZO2Lo1Xct51UkJ5g4GqIPhT9BTOu6F30uw4peqpoHs_wZhBv5ySfgmZUc7qOnzP55VRXCeMhAIVQV9IWk787k55tp_M-MBaVmkM5-UcSMNjVq9aEvj7suH0 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:06:43.833676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d3db3ac9cb13453fa7bc8195bdf88fd1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 6bb5a1f18dff4395bec9c205a9937493 Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:06:43.834981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Cannot 'detach_volume' instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 while it is in vm_state rescued Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'server_id': 'ad3faa61-9238-40ad-bc81-1ed5bf84f0d3', 'id': '6a58f985-dd17-4534-a548-8a1283ebf4db'} Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:06:43.835912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 while it is in vm_state rescued Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 while it is in vm_state rescued Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:06:43.837200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Returning 409 to user: Cannot 'detach_volume' instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 while it is in vm_state rescued {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:06:43.838218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6037e6e3-3e8b-4430-bd14-9461e55c63dc tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments/6a58f985-dd17-4534-a548-8a1283ebf4db" status: 409 len: 152 microversion: 2.1 time: 0.094860 Jun 23 11:06:43.838218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 325/638] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:06:43 2022] DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments/6a58f985-dd17-4534-a548-8a1283ebf4db => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 11:06:43.843749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:43.844283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.850166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.850610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.851362 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.851828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.873360 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:43.882100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:43.883616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:43.884820 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-67040739-52c0-4026-b164-6ee3e1ef7200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.160016 Jun 23 11:06:43.885373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 314/639] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:43 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:43.917616 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a7517ee2-35d4-40ba-aa7e-79b6a74a0622 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "POST /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/action" status: 202 len: 0 microversion: 2.1 time: 0.077395 Jun 23 11:06:43.918903 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 326/640] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:06:43 2022] POST /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:06:43.926329 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:43.926937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:43.933548 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.934001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:43.934764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:43.935202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:44.065763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:44.073671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a5a6c4c1-89f9-46ef-95b2-f1a14954656b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1720 microversion: 2.1 time: 0.151121 Jun 23 11:06:44.074231 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 315/641] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:43 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:44.700088 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:44.700778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:44.706860 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:44.707306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:44.708103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:44.708526 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:44.755205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:44.756102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:44.763063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:44.763504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:44.764284 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:44.764711 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:44.778713 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 HTTP/1.1 Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:06:44.780467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:06:44.782189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '2946bfb4-cd02-4237-8291-ad974a96ded6'} Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:06:44.783086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:06:44.784513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:06:44.785795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:06:44.785795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-eeb7adfd-6143-4d18-83b4-6c52b15d5a04 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 404 len: 111 microversion: 2.1 time: 0.030443 Jun 23 11:06:44.785795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 316/642] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:44 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:06:44.790530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4ac01431-32f3-4f09-af4d-694a498df02e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '.version_select at 0x7f089c99e670>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:44.810263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4ac01431-32f3-4f09-af4d-694a498df02e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869964053" status: 202 len: 0 microversion: 2.1 time: 0.023324 Jun 23 11:06:44.810832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 317/643] 10.222.0.65 () {58 vars in 1220 bytes} [Thu Jun 23 11:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869964053 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:06:44.849104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:44.857484 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d1dfcbc7-ca27-4395-98e0-4b2ecf0aa86e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.162834 Jun 23 11:06:44.858047 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 327/644] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:44 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:44.902975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:44.903589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:44.910500 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:44.910952 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:44.911741 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:44.912180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:45.090523 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:45.091054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:45.097667 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:45.098119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:45.098892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:45.099307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:45.154559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:45.163393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:45.165044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:45.166238 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b21e41ca-51c7-4e48-b7fc-fcfde12fa863 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.267730 Jun 23 11:06:45.166788 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 318/645] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:44 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:45.229318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:45.237166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9c7dd815-60e3-4148-bc96-3ef89c5e147b tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1720 microversion: 2.1 time: 0.150626 Jun 23 11:06:45.237720 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 328/646] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:45 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:45.496011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-545d65ee-f4c8-4dbe-b288-23d2e3fe9989 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: .version_select at 0x7f089c721af0>, body: {"keypair": {"name": "tempest-keypair-61419142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqFNorvPBZixj5z52LesUrlzizfvTwkpHHAcU3AIUtJkN5q7XIjFz1YzCOHivYmKFUxtZp1WLmuwYWx9XUnHgpPZ9f77WtnxgZcI0dKJKJ9QqbMmY1apAASRJegvYSDIg=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:45.510564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-545d65ee-f4c8-4dbe-b288-23d2e3fe9989 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:06:45.515165 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-545d65ee-f4c8-4dbe-b288-23d2e3fe9989 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:06:45.539335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-545d65ee-f4c8-4dbe-b288-23d2e3fe9989 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.047899 Jun 23 11:06:45.539957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 319/647] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:06:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:45.874639 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:45.875378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:45.882182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:45.882626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:45.883391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:45.883855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:46.018569 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:46.027506 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4c9c2798-216c-4cff-9368-8e99777631f4 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.156785 Jun 23 11:06:46.036988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 329/648] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:45 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:46.184841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:46.185449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:46.187305 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:46.192655 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:46.193105 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:46.193882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:46.194321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:46.254792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:46.255521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:46.262619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:46.263161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:46.264042 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:46.264540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:46.393229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:46.398245 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:46.403529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7fc3df6b-7fa4-41bc-8d1a-e4371c1f60a0 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1720 microversion: 2.1 time: 0.152631 Jun 23 11:06:46.409615 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:46.411611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:46.412935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7f6f1589-26dd-4225-810e-f2e64cdfff09 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.232533 Jun 23 11:06:46.413236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 330/649] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:46 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:46.413887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 320/650] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:46 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:46.850147 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1544442732", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b879fb0c-6f1b-457c-8797-97d9533d8257"}], "security_groups": [{"name": "tempest-securitygroup--992973661"}], "key_name": "tempest-keypair-61419142", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:46.948780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] validate_networks() for [('b879fb0c-6f1b-457c-8797-97d9533d8257', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:06:47.045123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:47.045853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:47.052138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.052593 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.053363 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.053919 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.186400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:47.193911 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-adddf0dc-2fe7-468a-87f5-6b93e2f40da1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.153131 Jun 23 11:06:47.194732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 321/651] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:47 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:47.311180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:06:47.311603 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:06:47.312112 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:06:47.312520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:06:47.312931 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:06:47.321680 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.322129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.323024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.323458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.340182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:06:47.344092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:06:47.355461 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:06:47.357716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:06:47.405544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-53129203-569d-48ad-ba0f-2c8ab878b5f8 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.559589 Jun 23 11:06:47.406425 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 331/652] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:06:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:06:47.417048 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-412f265d-b81f-45ca-a1f3-df26c7a384da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:47.417667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-412f265d-b81f-45ca-a1f3-df26c7a384da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:47.420080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:47.420897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:47.428916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.429428 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.430262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.430768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.474168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-412f265d-b81f-45ca-a1f3-df26c7a384da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:47.481561 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-412f265d-b81f-45ca-a1f3-df26c7a384da tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1240 microversion: 2.1 time: 0.069218 Jun 23 11:06:47.490887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 322/653] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:47 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:47.495847 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:47.496455 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:47.502835 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.503166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.504026 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.504474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.594155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:47.602298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-89a5e3fb-f21f-4cd8-85ea-e7f861bf891a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1726 microversion: 2.1 time: 0.186603 Jun 23 11:06:47.603217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 332/654] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:47 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:47.619904 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:47.620616 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:47.628087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.628743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.629667 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:47.630291 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:47.648520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:47.657973 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:47.662975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:47.664396 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5a8fa78b-8f17-4971-878c-9d95400bbff3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.172268 Jun 23 11:06:47.665761 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 323/655] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:47 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:47.711061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6eae47c1-98f4-452a-92de-c9eca0ad99ab tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095304 Jun 23 11:06:47.712092 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 333/656] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:06:47 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:48.211634 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:48.212270 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:48.224980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:48.225528 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:48.226449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:48.226970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:48.362767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:48.370835 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f427b9e3-3663-4616-b8dc-500f0221ea21 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.163076 Jun 23 11:06:48.371619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 324/657] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:48 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:48.500028 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:48.500667 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:48.508534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:48.508979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:48.509767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:48.510204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:48.682823 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:48.683355 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:48.689507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:48.689959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:48.690737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:48.691365 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:48.695262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:48.703824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fca0adf1-cf47-4956-b546-c8862b25b19f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1310 microversion: 2.1 time: 0.209248 Jun 23 11:06:48.704391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 334/658] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:48 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:48.824311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:48.833086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:48.834702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:48.836000 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0a28a6d1-7c30-4ec0-ad73-0d51bf69dcb6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.157236 Jun 23 11:06:48.836964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 325/659] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:48 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:49.006249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-5658a069-a920-486b-a30a-3b49b6df1b4f req-0e9f602e-5dc8-4181-aed7-a3505d737c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3faa61-9238-40ad-bc81-1ed5bf84f0d3", "tag": "3909cef4-3010-4515-8cab-d60278b2d3ee"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:49.014787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5658a069-a920-486b-a30a-3b49b6df1b4f req-0e9f602e-5dc8-4181-aed7-a3505d737c9d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.015462 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-5658a069-a920-486b-a30a-3b49b6df1b4f req-0e9f602e-5dc8-4181-aed7-a3505d737c9d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.027468 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-5658a069-a920-486b-a30a-3b49b6df1b4f req-0e9f602e-5dc8-4181-aed7-a3505d737c9d service nova] Creating event network-changed:3909cef4-3010-4515-8cab-d60278b2d3ee for instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 on hv-cinder-84330 Jun 23 11:06:49.034081 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-5658a069-a920-486b-a30a-3b49b6df1b4f req-0e9f602e-5dc8-4181-aed7-a3505d737c9d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031858 Jun 23 11:06:49.035185 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 335/660] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:06:49.388968 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:49.390289 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:49.398386 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.399053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.400079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.401196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.567607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:49.578668 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a7448f57-dbcf-4d8c-9f34-585282f2a2f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.194050 Jun 23 11:06:49.579251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 326/661] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:49 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:49.722703 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:49.723434 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:49.733856 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.734343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.735130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.735563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.854309 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:49.855040 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:49.861095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.861611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.862443 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:49.862941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:49.872957 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:49.880609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-161b1f60-c2f0-4579-8cff-eee8f076c11a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.162903 Jun 23 11:06:49.881519 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 336/662] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:49 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:49.987647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:49.995995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:49.997497 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:49.998653 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b156e3ff-bf83-4a5b-9f16-f27a790d643a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.148304 Jun 23 11:06:49.999229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 327/663] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:49 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:06:50.597612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:50.601214 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:50.610381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:50.610824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:50.611837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:50.612268 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:50.828012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:50.835632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-57687c7f-8d78-4768-8f15-d609fb20b5cb tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.242305 Jun 23 11:06:50.836288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 337/664] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:50 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:50.898167 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:50.898751 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:50.905882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:50.906323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:50.907116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:50.907556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:51.016957 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:51.017565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:51.023483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:51.024223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:51.024997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:51.025473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:51.040194 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:51.056079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-94f22dad-e1e7-4694-8513-ca26c039f77f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.161522 Jun 23 11:06:51.056557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 328/665] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:50 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:51.061587 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-dcca4e0c-9ba0-4851-9dd2-d03fdc5786c8 req-0e869dff-6776-413b-af5a-c47d76cec0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3faa61-9238-40ad-bc81-1ed5bf84f0d3", "tag": "3909cef4-3010-4515-8cab-d60278b2d3ee"}, {"name": "network-changed", "server_uuid": "3eed5440-b2dd-4413-84ff-fe74e9bdbf0d", "tag": "4e4920d7-a569-4567-ba7e-9c995b534d53"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:51.070525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-dcca4e0c-9ba0-4851-9dd2-d03fdc5786c8 req-0e869dff-6776-413b-af5a-c47d76cec0b5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:51.070971 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-dcca4e0c-9ba0-4851-9dd2-d03fdc5786c8 req-0e869dff-6776-413b-af5a-c47d76cec0b5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:51.083826 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-dcca4e0c-9ba0-4851-9dd2-d03fdc5786c8 req-0e869dff-6776-413b-af5a-c47d76cec0b5 service nova] Creating event network-changed:3909cef4-3010-4515-8cab-d60278b2d3ee for instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 on hv-cinder-84330 Jun 23 11:06:51.084338 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-dcca4e0c-9ba0-4851-9dd2-d03fdc5786c8 req-0e869dff-6776-413b-af5a-c47d76cec0b5 service nova] Creating event network-changed:4e4920d7-a569-4567-ba7e-9c995b534d53 for instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d on hv-cinder-84330 Jun 23 11:06:51.094352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-dcca4e0c-9ba0-4851-9dd2-d03fdc5786c8 req-0e869dff-6776-413b-af5a-c47d76cec0b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036066 Jun 23 11:06:51.095175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 329/666] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:51.196152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:51.205658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:51.207195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:51.208367 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f1667f75-1d50-41ef-9024-3778b94f977a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.195340 Jun 23 11:06:51.208920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 338/667] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:51 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:51.854644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:51.855372 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:51.861595 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:51.862047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:51.862808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:51.863244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:51.989232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:51.996706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e20919c3-617d-4ea9-9aea-ee343dd5aeb1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.147006 Jun 23 11:06:51.997267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 330/668] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:51 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:52.072087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:52.073201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:52.079642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:52.080135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:52.080921 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:52.081347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:52.209015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:52.217108 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4ebc2742-e732-4e9b-9f15-fce4eb40e912 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.148822 Jun 23 11:06:52.217749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 339/669] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:52 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:52.226630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:52.227445 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:52.233523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:52.233964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:52.234722 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:52.235152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:52.680703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:52.690585 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:52.692152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:52.693292 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8b95afcf-96e6-404a-8ace-283b5c09a6e4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.470583 Jun 23 11:06:52.693837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 331/670] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:52 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:53.013532 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:53.014141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:53.020277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:53.020722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:53.021482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:53.021912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:53.026023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:53.156069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:53.163525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3452052e-2347-4ced-9e1b-cdfe7ab1bde6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1678 microversion: 2.1 time: 0.153962 Jun 23 11:06:53.164043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 340/671] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:53 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:53.234061 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:53.234662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:53.241449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:53.241886 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:53.242650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:53.243080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:53.439940 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:53.447326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-58f76c5b-0dd6-4486-af80-3a62fe75dea5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.217043 Jun 23 11:06:53.447917 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 332/672] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:53 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:53.711578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:53.712291 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:53.718815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:53.719261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:53.720062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:53.720493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:53.850826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:53.859241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:53.860869 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:53.862016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5abb6feb-d005-4c7e-a263-a523b317fec3 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.154366 Jun 23 11:06:53.862571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 341/673] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:53 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:54.181131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:54.182252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:54.188396 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.188845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.189605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.190040 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.194176 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:54.317333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:54.324768 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6229466c-ed11-45ab-a062-f40dbc3e8b48 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1655 microversion: 2.1 time: 0.147469 Jun 23 11:06:54.325326 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 333/674] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:54 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:54.341040 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a049c0f-65c5-487d-8b69-104a6e12133d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:54.347577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a049c0f-65c5-487d-8b69-104a6e12133d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.347988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a049c0f-65c5-487d-8b69-104a6e12133d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.370577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a049c0f-65c5-487d-8b69-104a6e12133d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Going to try to start instance {{(pid=117877) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 11:06:54.410133 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a049c0f-65c5-487d-8b69-104a6e12133d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action" status: 202 len: 0 microversion: 2.1 time: 0.072768 Jun 23 11:06:54.410712 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 342/675] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:06:54 2022] POST /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:06:54.419427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:54.420076 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:54.426384 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.426861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.427628 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.428191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.464535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:54.465229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:54.471491 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.471967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.472719 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.473145 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.598197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:54.615542 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1a421c65-fb24-49f2-8599-5a10c491ced6 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1664 microversion: 2.1 time: 0.200431 Jun 23 11:06:54.616146 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 334/676] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:54 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:54.621798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:54.630698 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c140a541-7039-49f3-a862-e4cc6089f092 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.170417 Jun 23 11:06:54.631510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 343/677] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:54 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:54.880166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:54.880780 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:54.887013 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.887460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:54.888718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:54.888982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:55.094404 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:55.104767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:55.106201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:55.107343 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a9279ff3-5115-4ae4-8ef3-36e17d7f810f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.231119 Jun 23 11:06:55.107933 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 335/678] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:54 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:55.632835 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:55.633443 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:55.637157 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:55.641409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:55.641854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:55.642696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:55.643141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:55.647887 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:55.649370 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:55.656055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:55.656505 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:55.657466 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:55.658053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:55.839439 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:55.847900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f2944b30-3103-4bc9-acb7-26d995ae0c92 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1664 microversion: 2.1 time: 0.219088 Jun 23 11:06:55.848561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 344/679] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:55 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1664 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:55.854137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-8879eda5-9e98-45b1-8430-168cd4b1256d req-45254eb1-fde6-470a-bcee-539ac541a8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "name": "network-vif-plugged", "status": "completed", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:55.863372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-8879eda5-9e98-45b1-8430-168cd4b1256d req-45254eb1-fde6-470a-bcee-539ac541a8a2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:55.864796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-8879eda5-9e98-45b1-8430-168cd4b1256d req-45254eb1-fde6-470a-bcee-539ac541a8a2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:55.875278 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:55.877267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-8879eda5-9e98-45b1-8430-168cd4b1256d req-45254eb1-fde6-470a-bcee-539ac541a8a2 service nova] Creating event network-vif-plugged:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:06:55.883037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-8879eda5-9e98-45b1-8430-168cd4b1256d req-45254eb1-fde6-470a-bcee-539ac541a8a2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Jun 23 11:06:55.883920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-32bc585d-e636-43ad-8e06-4878f49883dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.239976 Jun 23 11:06:55.884070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 345/680] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:55.884885 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 336/681] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:55 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:56.126815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:56.127503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:56.134297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:56.134642 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:56.135410 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:56.135876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:56.267240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:56.276766 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:56.278442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:56.279601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f0595618-3548-4ced-8a9b-973ab3d95a49 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.157136 Jun 23 11:06:56.280189 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 346/682] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:56 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:56.865834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:56.866549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:56.872736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:56.873177 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:56.873933 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:56.874366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:56.900048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:56.901232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:56.907854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:56.908309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:56.909243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:56.909689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:57.002091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:57.010460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f79f2880-9e72-4aeb-9c2a-e3471000bcf0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1668 microversion: 2.1 time: 0.148088 Jun 23 11:06:57.011179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 337/683] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:56 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1668 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:57.039188 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:57.046532 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4961c9a4-8b3d-493d-89de-b620b4934059 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.150310 Jun 23 11:06:57.047095 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 347/684] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:56 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:06:57.298154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:57.298755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:57.304856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:57.305299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:57.306047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:57.306472 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:57.433770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:57.442012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:57.443502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:57.444657 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9b33ee3a-d7ae-458d-8c20-5d5f94b35c7b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.150387 Jun 23 11:06:57.445198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 338/685] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:57 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:57.898221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-fa0fdc42-4eea-4c07-85c3-cbdd01a351bc req-6e5ee98a-9988-4d40-94e7-6197a7b6e453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eed5440-b2dd-4413-84ff-fe74e9bdbf0d", "name": "network-vif-plugged", "status": "completed", "tag": "4e4920d7-a569-4567-ba7e-9c995b534d53"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:06:57.902290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:57.902938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:57.909658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-fa0fdc42-4eea-4c07-85c3-cbdd01a351bc req-6e5ee98a-9988-4d40-94e7-6197a7b6e453 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:57.909894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-fa0fdc42-4eea-4c07-85c3-cbdd01a351bc req-6e5ee98a-9988-4d40-94e7-6197a7b6e453 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:57.921344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-fa0fdc42-4eea-4c07-85c3-cbdd01a351bc req-6e5ee98a-9988-4d40-94e7-6197a7b6e453 service nova] Creating event network-vif-plugged:4e4920d7-a569-4567-ba7e-9c995b534d53 for instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d on hv-cinder-84330 Jun 23 11:06:57.926038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-fa0fdc42-4eea-4c07-85c3-cbdd01a351bc req-6e5ee98a-9988-4d40-94e7-6197a7b6e453 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Jun 23 11:06:57.926601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 348/686] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:06:58.062979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:58.063589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:58.065459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=6 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:58.071168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:58.071612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:58.072949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:58.073388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:58.203303 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:58.210811 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-dfd70efb-ffa9-4cdd-8b7f-5b6ab022732f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.151652 Jun 23 11:06:58.211682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 339/687] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:58 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:58.463199 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:58.463920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:58.469999 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:58.470438 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:58.471202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:58.471790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:58.606080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:58.614586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:58.616180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:58.617346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0f40d92f-2247-4847-b686-2eae555155eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1805 microversion: 2.20 time: 0.158494 Jun 23 11:06:58.617948 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 349/688] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:58 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:06:59.228394 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:59.229693 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:59.236392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:59.236857 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:59.237609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:59.238035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:59.368920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:59.376225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-68a64581-dc5e-4446-9695-5d638c574216 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.151933 Jun 23 11:06:59.376782 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 340/689] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:06:59 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:06:59.636672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:06:59.637262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:06:59.643645 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:59.644117 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:59.644869 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:06:59.645301 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:06:59.773030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:59.782753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:59.784329 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:06:59.785510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8870a416-2132-47ec-bda3-d4c998e07f32 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1792 microversion: 2.20 time: 0.153620 Jun 23 11:06:59.786066 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 350/690] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:06:59 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1792 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:07:00.393194 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:00.393735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:00.400303 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:00.400760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:00.401515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:00.401950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:00.527457 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:00.534837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7b5ebd44-5743-4ff2-8a70-57b3f047815e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1365 microversion: 2.1 time: 0.145587 Jun 23 11:07:00.535401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 341/691] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:00 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:01.551940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:01.552553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:01.559666 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:01.560128 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:01.560887 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:01.561321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:01.687773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:01.695061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec8f5b54-c86e-4353-b771-954a34bc2984 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1554 microversion: 2.1 time: 0.147036 Jun 23 11:07:01.695626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 351/692] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:01 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:01.711545 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:01.712064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:01.718467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:01.718907 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:01.719679 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:01.720126 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:01.799182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-dd1aa946-83c3-4e2b-8432-1e8b5af5119e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091366 Jun 23 11:07:01.799803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 342/693] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:07:01 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:02.689605 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-28fe18e0-34fc-4418-a15f-6b1e4da4ecc9 req-5ccecf16-e97d-4b2c-aa59-73dc500c8de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eed5440-b2dd-4413-84ff-fe74e9bdbf0d", "tag": "4e4920d7-a569-4567-ba7e-9c995b534d53"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:02.698649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-28fe18e0-34fc-4418-a15f-6b1e4da4ecc9 req-5ccecf16-e97d-4b2c-aa59-73dc500c8de7 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:02.699093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-28fe18e0-34fc-4418-a15f-6b1e4da4ecc9 req-5ccecf16-e97d-4b2c-aa59-73dc500c8de7 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:02.710119 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-28fe18e0-34fc-4418-a15f-6b1e4da4ecc9 req-5ccecf16-e97d-4b2c-aa59-73dc500c8de7 service nova] Creating event network-changed:4e4920d7-a569-4567-ba7e-9c995b534d53 for instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d on hv-cinder-84330 Jun 23 11:07:02.715489 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-28fe18e0-34fc-4418-a15f-6b1e4da4ecc9 req-5ccecf16-e97d-4b2c-aa59-73dc500c8de7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029537 Jun 23 11:07:02.716121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 352/694] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:17.390770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:07:17.391292 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:07:36.656491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=47 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:36.657337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=56 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:36.661425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:36.661939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:36.669347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:36.669796 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:36.670558 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:36.670996 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:36.754214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lazy-loading 'services' on Instance uuid ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:07:36.823357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b2d6fcbd-bb1f-47f3-82b9-f770d1e85199 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments/6a58f985-dd17-4534-a548-8a1283ebf4db" status: 202 len: 0 microversion: 2.1 time: 0.168208 Jun 23 11:07:36.823967 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 343/695] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:07:36 2022] DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments/6a58f985-dd17-4534-a548-8a1283ebf4db => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:07:36.830757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=17 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:36.831485 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:36.837140 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:36.838138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:36.847098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:36.847543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:36.849208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:36.849648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:36.882480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3800fa0-707d-4844-83c2-af869c906649 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053583 Jun 23 11:07:36.883019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 353/696] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:07:36 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:37.895569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:37.896697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:37.902945 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:37.903396 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:37.904191 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:37.904685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:37.933413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e5e96dcf-100d-46cd-b830-b6f0ed20d2d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042567 Jun 23 11:07:37.933882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 344/697] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:07:37 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:38.945791 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:38.946629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:38.953055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:38.953504 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:38.954260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:38.954697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:38.983633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5763f83a-d3b1-4a43-85d6-0344dfac00f3 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041955 Jun 23 11:07:38.984191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 354/698] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:07:38 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 11:07:39.059537 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:39.060596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:39.066937 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:39.067393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:39.068210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:39.068653 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:39.093793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:07:39.166606 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c746e3d1-952b-43a2-8d38-11700f787a9f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 204 len: 0 microversion: 2.1 time: 0.110625 Jun 23 11:07:39.167676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 345/699] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:07:39 2022] DELETE /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:07:39.175847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:39.176542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:39.182531 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:39.182976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:39.183755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:39.184190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:39.314995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:39.322460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-856b32cd-2731-46f0-ad90-af686488d98a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1686 microversion: 2.1 time: 0.150535 Jun 23 11:07:39.323023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 355/700] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:39 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:40.339946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:40.340644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:40.347729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:40.348129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:40.348924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:40.349361 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:40.478733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:40.486202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3d04b582-785c-4133-867c-7694bac0bc06 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1686 microversion: 2.1 time: 0.150555 Jun 23 11:07:40.486768 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 346/701] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:40 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:41.503094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:41.503744 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:41.510556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:41.511003 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:41.511794 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:41.512230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:41.637386 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:41.645413 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1de29746-4874-4743-8317-5925e44a17de tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1686 microversion: 2.1 time: 0.146230 Jun 23 11:07:41.645969 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 356/702] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:41 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1686 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:42.040340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:42.040902 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:42.047231 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.047706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.048474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.048911 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.077435 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a1fd4856-48e7-4f79-b33a-734d07c84dcb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments/8b5d63bd-22b7-46a4-ad4c-257746d99aec" status: 200 len: 194 microversion: 2.20 time: 0.041093 Jun 23 11:07:42.077985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 347/703] 10.222.0.65 () {60 vars in 1453 bytes} [Thu Jun 23 11:07:42 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments/8b5d63bd-22b7-46a4-ad4c-257746d99aec => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:07:42.138316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:42.139446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:42.145450 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.145898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.146652 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.147120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.223538 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lazy-loading 'services' on Instance uuid 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:07:42.291982 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-378de48c-7b2c-4b41-819a-661b97f7713c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments/8b5d63bd-22b7-46a4-ad4c-257746d99aec" status: 202 len: 0 microversion: 2.20 time: 0.157310 Jun 23 11:07:42.292493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 357/704] 10.222.0.65 () {60 vars in 1456 bytes} [Thu Jun 23 11:07:42 2022] DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments/8b5d63bd-22b7-46a4-ad4c-257746d99aec => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:07:42.301239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:42.302150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:42.308050 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.308490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.309334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.309764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.338232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bf5150ff-4bf7-465c-b69f-fa3e492e5f87 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040895 Jun 23 11:07:42.338758 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 348/705] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:42 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:07:42.663860 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:42.664487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:42.670712 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.671163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.671947 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:42.672386 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:42.796272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:42.803570 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dad276d8-626a-4175-aebc-2fa19a3528f8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1686 microversion: 2.1 time: 0.144520 Jun 23 11:07:42.804153 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 358/706] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:42 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1686 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:43.102882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:43.103367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:43.109862 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.110314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.111079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.111526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.137961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:07:43.210929 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9a7f6fbb-726d-4fbf-a00b-381cf6643c12 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 204 len: 0 microversion: 2.1 time: 0.111686 Jun 23 11:07:43.211489 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 349/707] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:07:43 2022] DELETE /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:07:43.219493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:43.220131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:43.226113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.226561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.227331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.227776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.350448 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:43.351455 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:43.356756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:43.358131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.358584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.359388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.359856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.365019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d16556a2-4c18-49f5-8944-94962150c67a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1578 microversion: 2.1 time: 0.149361 Jun 23 11:07:43.365582 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 359/708] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:43 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:43.388523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a7ebf5bd-360b-4dbd-8bae-d3cc0377f019 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042378 Jun 23 11:07:43.389224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 350/709] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:43 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:07:43.821433 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:43.822037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:43.829042 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.829481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.830235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:43.830669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:43.956663 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:43.964244 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cf34331c-a5e6-4140-b1b9-f6a899043b51 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1686 microversion: 2.1 time: 0.146829 Jun 23 11:07:43.964775 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 360/710] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:43 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1686 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:44.382319 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:44.382858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:44.389576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.390021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:44.391584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.391907 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:44.400800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:44.401792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:44.407835 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.408274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:44.409022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.409456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:44.438990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3ece6ed3-a127-460c-b14d-8a7cb294b89e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041989 Jun 23 11:07:44.439545 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 361/711] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:44 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:07:44.520385 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:44.527705 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4b48415c-13b0-42cb-9757-c1b50ce84964 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1578 microversion: 2.1 time: 0.149240 Jun 23 11:07:44.528259 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 351/712] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:44 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:44.981577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:44.982260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:44.988684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.989131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:44.989885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:44.990318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.122883 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:45.130214 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2878452-88d3-48d2-89fd-10243af3ff25 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1686 microversion: 2.1 time: 0.152510 Jun 23 11:07:45.130816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 362/713] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:44 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:45.229514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:45.230585 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:45.236846 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.245080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.245997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.246515 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.276617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c9e71177-2ec6-4592-98a7-d11bcf5b5e20 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051012 Jun 23 11:07:45.277171 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 352/714] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:07:45 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:07:45.338121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:45.338703 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:45.345485 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.345998 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.346821 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.347321 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.372242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:07:45.447769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d6053c6-935f-4700-8ecb-f1fecbcace2e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 204 len: 0 microversion: 2.1 time: 0.113301 Jun 23 11:07:45.448353 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 363/715] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:07:45 2022] DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:07:45.451630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:45.453172 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:45.456872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:45.457566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:45.461262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.461960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.463569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.463722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.464048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.464615 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.464813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.465233 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.495443 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f9f6fe17-4b4b-4aff-ae00-968d4c9527d0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048564 Jun 23 11:07:45.496282 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 353/716] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:45 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:07:45.545163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:45.545819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:45.553505 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.553961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.554747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:45.555201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:45.612527 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:45.620577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b7b38e70-6e1b-4d43-99a4-d01b79681332 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1674 microversion: 2.1 time: 0.167817 Jun 23 11:07:45.621164 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 364/717] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:45 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:45.942644 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:45.950939 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2a2bf433-177d-4e17-a34a-914e80e40228 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1578 microversion: 2.1 time: 0.409904 Jun 23 11:07:45.951503 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 354/718] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:45 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1578 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:46.147370 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:46.148011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:46.154163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.154611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.155381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.155916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.217078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:46.226065 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cdc5560-9c09-4b7f-a156-8017ee5c7f22 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1620 microversion: 2.1 time: 0.082550 Jun 23 11:07:46.226644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 365/719] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:46 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1620 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:46.452055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-31cddadc-4c60-4859-abd0-5b908bd4e622 req-33d88d26-ea8f-45f5-8092-42defeede78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3faa61-9238-40ad-bc81-1ed5bf84f0d3", "name": "network-vif-deleted", "tag": "3909cef4-3010-4515-8cab-d60278b2d3ee"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:46.460322 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-31cddadc-4c60-4859-abd0-5b908bd4e622 req-33d88d26-ea8f-45f5-8092-42defeede78f service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.460860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-31cddadc-4c60-4859-abd0-5b908bd4e622 req-33d88d26-ea8f-45f5-8092-42defeede78f service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.473829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-31cddadc-4c60-4859-abd0-5b908bd4e622 req-33d88d26-ea8f-45f5-8092-42defeede78f service nova] Creating event network-vif-deleted:3909cef4-3010-4515-8cab-d60278b2d3ee for instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 on hv-cinder-84330 Jun 23 11:07:46.479049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-31cddadc-4c60-4859-abd0-5b908bd4e622 req-33d88d26-ea8f-45f5-8092-42defeede78f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097812 Jun 23 11:07:46.480151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 355/720] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:46.506930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:46.508073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:46.514886 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.515520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.516216 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.516839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.549306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-99912e1a-7f18-4687-aed7-21af5eb6d0ee tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046615 Jun 23 11:07:46.550081 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 366/721] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:46 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:07:46.639217 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:46.639869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:46.647018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.647472 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.648266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.648708 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.652825 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:46.791514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:46.799485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-35a9aa07-a1ba-472a-b6fa-2933d2e8b56f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1674 microversion: 2.1 time: 0.164552 Jun 23 11:07:46.800079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 356/722] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:46 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:46.969220 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:46.969825 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:46.975728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.976182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.976942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:46.977380 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:46.981450 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:47.116430 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:47.124307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdc75323-efd1-4c03-927b-7892d363d2f9 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1578 microversion: 2.1 time: 0.159595 Jun 23 11:07:47.125388 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 367/723] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:46 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:47.243704 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:47.244315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:47.250345 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.250791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.251553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.252011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.313102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:47.320529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-08442277-5101-48f0-a7c5-28d72a75ae3a tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1620 microversion: 2.1 time: 0.080676 Jun 23 11:07:47.321086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 357/724] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:47 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1620 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:47.560121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:47.561109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:47.568283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.568722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.569464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.569889 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.598357 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-afaea11b-67c3-4a5e-9918-eb7350a8171d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042321 Jun 23 11:07:47.598880 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 368/725] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:47 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:07:47.817247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:47.817757 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:47.824332 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.824776 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.825526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:47.825956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:47.954164 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:47.962037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fd1891ec-f659-4688-8b5f-cd7bd732e3bc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1674 microversion: 2.1 time: 0.148611 Jun 23 11:07:47.963334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 358/726] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:47 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:48.142005 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.142604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.148828 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.149275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.150019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.150445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.279382 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:48.288176 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d11246ea-c255-4e95-b4e9-bffd2e1980ef tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1578 microversion: 2.1 time: 0.150011 Jun 23 11:07:48.288732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 369/727] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:48 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:48.336639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.337251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.343235 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.344295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.345054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.345486 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.374564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.374960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.375401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lazy-loading 'fault' on Instance uuid ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:07:48.418750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:48.426700 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a924d511-da80-4b38-9b1b-bd1c205e8765 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 200 len: 1334 microversion: 2.1 time: 0.093899 Jun 23 11:07:48.427247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 359/728] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:48 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:48.612696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.614409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.622326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.623184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.624256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.625063 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.674404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f3e860d0-88ca-4bee-b895-1fed10984b62 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.066931 Jun 23 11:07:48.675094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 370/729] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:07:48 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:48.738379 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.738872 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.745091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.745542 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.746311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.746747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.772100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:07:48.855482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9657ac3c-7d74-496f-a6fe-6ebb7b35f023 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 204 len: 0 microversion: 2.20 time: 0.120788 Jun 23 11:07:48.859732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 360/730] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Jun 23 11:07:48 2022] DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:07:48.866529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.867251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.873834 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.874395 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.875938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.876405 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.980648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:48.981330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:48.987863 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.988311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:48.989071 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:48.989498 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.097446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:49.122978 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:49.124817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:49.126278 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef28e4d3-17f9-44bd-b95a-48ba0b976ae8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.263741 Jun 23 11:07:49.135633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 371/731] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:48 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:07:49.215550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:49.227115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d0e65f1e-fbd9-4b3d-b0c7-f776df2a29d1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1674 microversion: 2.1 time: 0.250621 Jun 23 11:07:49.227836 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 361/732] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:48 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:49.262126 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:49.262644 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:49.269643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.270098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.271098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.271685 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.297581 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73dd36a3-e2b0-4cec-92fa-95ef2595244c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/ips" status: 200 len: 149 microversion: 2.1 time: 0.132823 Jun 23 11:07:49.298372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 372/733] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:07:49 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/ips => generated 149 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:07:49.305883 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:49.306493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:49.313609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.314056 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.314872 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.315311 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.444651 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:49.445463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: ad3faa61-9238-40ad-bc81-1ed5bf84f0d3] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:49.455241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:49.466467 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.466877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.473687 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.475138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.475694 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b528b342-0312-4d2f-9adc-62df8708c0ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1510 microversion: 2.1 time: 0.174273 Jun 23 11:07:49.485853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 362/734] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:49 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:49.527406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] HTTP exception thrown: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 could not be found. Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Request method failure captured: Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 HTTP/1.1 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEg3iINLTSjOhWRw2HyLGSvSdbOBEFBaAq4FQvIugZYQsYteQvjoiPUsZO2Lo1Xct51UkJ5g4GqIPhT9BTOu6F30uw4peqpoHs_wZhBv5ySfgmZUc7qOnzP55VRXCeMhAIVQV9IWk787k55tp_M-MBaVmkM5-UcSMNjVq9aEvj7suH0 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:07:49.533850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d3db3ac9cb13453fa7bc8195bdf88fd1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 6bb5a1f18dff4395bec9c205a9937493 Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 could not be found. Jun 23 11:07:49.535563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': 'ad3faa61-9238-40ad-bc81-1ed5bf84f0d3'} Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 could not be found. Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:07:49.536623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 could not be found. Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 could not be found. Jun 23 11:07:49.538316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:49.541136 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Returning 404 to user: Instance ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:07:49.542173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16dfa537-3ae2-4ff6-8c51-e619bbdd7fb5 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3" status: 404 len: 111 microversion: 2.1 time: 0.102211 Jun 23 11:07:49.542990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 373/735] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:49 2022] GET /compute/v2.1/servers/ad3faa61-9238-40ad-bc81-1ed5bf84f0d3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:07:49.557118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-06d0ca70-c4bd-44b1-ad48-8d4204ef3e43 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '.version_select at 0x7f089c6a00d0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:49.564972 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-8a0b7506-715c-4b73-90d2-e983fd9b075a req-7cd55cd3-4c43-44aa-b11b-494b322e4d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f49b10a-300a-4cca-bc81-35841bde257c", "name": "network-vif-deleted", "tag": "5cc271a1-6f9b-43a0-963f-fc7a9395a997"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:49.578950 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-8a0b7506-715c-4b73-90d2-e983fd9b075a req-7cd55cd3-4c43-44aa-b11b-494b322e4d00 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.579383 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-8a0b7506-715c-4b73-90d2-e983fd9b075a req-7cd55cd3-4c43-44aa-b11b-494b322e4d00 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.599950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-06d0ca70-c4bd-44b1-ad48-8d4204ef3e43 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18194251" status: 202 len: 0 microversion: 2.1 time: 0.052055 Jun 23 11:07:49.600745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 363/736] 10.222.0.65 () {58 vars in 1214 bytes} [Thu Jun 23 11:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18194251 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:07:49.634656 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-8a0b7506-715c-4b73-90d2-e983fd9b075a req-7cd55cd3-4c43-44aa-b11b-494b322e4d00 service nova] Creating event network-vif-deleted:5cc271a1-6f9b-43a0-963f-fc7a9395a997 for instance 6f49b10a-300a-4cca-bc81-35841bde257c on hv-cinder-84330 Jun 23 11:07:49.679039 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-8a0b7506-715c-4b73-90d2-e983fd9b075a req-7cd55cd3-4c43-44aa-b11b-494b322e4d00 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117652 Jun 23 11:07:49.681571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 374/737] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:07:49.958190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-1144131d-8de5-433e-b2f2-c78e0231a83e req-521f8098-ecc4-414e-84c0-f3481c3c60a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d", "name": "network-vif-deleted", "tag": "f38d95a7-ab3e-47d6-991b-c6ccc781d5fe"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:49.970334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-1144131d-8de5-433e-b2f2-c78e0231a83e req-521f8098-ecc4-414e-84c0-f3481c3c60a8 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:49.970785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-1144131d-8de5-433e-b2f2-c78e0231a83e req-521f8098-ecc4-414e-84c0-f3481c3c60a8 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:49.984954 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-1144131d-8de5-433e-b2f2-c78e0231a83e req-521f8098-ecc4-414e-84c0-f3481c3c60a8 service nova] Creating event network-vif-deleted:f38d95a7-ab3e-47d6-991b-c6ccc781d5fe for instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d on hv-cinder-84330 Jun 23 11:07:49.990558 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-1144131d-8de5-433e-b2f2-c78e0231a83e req-521f8098-ecc4-414e-84c0-f3481c3c60a8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122520 Jun 23 11:07:49.991163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 364/738] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:50.150132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:50.152472 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:50.164848 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.165579 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.166576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.167118 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.246559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:50.247233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:50.261063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.261520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.262300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.264699 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.355706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:50.365251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:50.377984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:50.383214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:50.402654 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1c59b3e3-bd4f-4427-b52c-08bed0995017 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.260204 Jun 23 11:07:50.404430 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 375/739] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:50 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:07:50.418371 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5c054a69-cab6-49f4-aefa-3f68134e31f7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 200 len: 1607 microversion: 2.1 time: 0.177097 Jun 23 11:07:50.419387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 365/740] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:50 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 1607 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:50.500878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:50.502868 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:50.520595 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.521761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.522733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.523316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.598288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:50.607232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a95f7e4c-9357-4089-a0e5-497b0ac7fbd7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1225 microversion: 2.1 time: 0.117094 Jun 23 11:07:50.608189 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 376/741] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:50 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:50.835151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:50.837026 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:50.845063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.845788 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:50.846731 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:50.847163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.376896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1cecc5be-d410-4e1d-9e66-b42438d3a80e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.545889 Jun 23 11:07:51.377543 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 366/742] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:07:50 2022] POST /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:51.423339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:51.424675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:51.437346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:51.438377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:51.439413 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.440016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.440892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.441774 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.445093 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.446858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.446858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.446858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.462817 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] HTTP exception thrown: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Request method failure captured: Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d HTTP/1.1 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEg2ZrjJvdQQCsoWQKA0NrSTZ0XXIRUelnfDYETx8ssH1dzLuWqsg66LvXdwVpZ_JXY7dw2oyX5ncZKgeMfQhlPFjG3P6nsDZ-7Rl2MdVIlM8kYzQnReHHgafXPZ9HPCu-B4Z-aQ3YqluwtpCR2VgwEWRkHqHXAI6CX_y0y3zObTRx8 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:07:51.464491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ac9f9313c3ac4dde97e75ac6fa8fae11", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 303e8aae1bd04228bedb145dec891a3e Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:07:51.466099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d'} Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:07:51.466941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:07:51.468425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:51.470241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Returning 404 to user: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:07:51.470241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8d7dbfae-25ad-43d7-8e9e-619f31da3d4c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 404 len: 111 microversion: 2.1 time: 0.032901 Jun 23 11:07:51.470241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 367/743] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:51 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:07:51.476524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a2d42b23-7c35-4f37-97ae-5282368f4e18 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '.version_select at 0x7f089c642c10>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:51.499690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a2d42b23-7c35-4f37-97ae-5282368f4e18 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289128500" status: 202 len: 0 microversion: 2.1 time: 0.026940 Jun 23 11:07:51.500778 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 368/744] 10.222.0.65 () {58 vars in 1220 bytes} [Thu Jun 23 11:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289128500 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:07:51.626781 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:51.627685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:51.637053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.637726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.638770 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.639404 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.653271 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:51.661994 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:51.663888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:51.665056 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fa9e37a5-d2a0-4a67-91a2-9ee4e060804c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1720 microversion: 2.20 time: 0.246624 Jun 23 11:07:51.666073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 377/745] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:51 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:07:51.710366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:51.713933 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:51.714608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lazy-loading 'fault' on Instance uuid 6f49b10a-300a-4cca-bc81-35841bde257c {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:07:51.814641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:51.824625 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-07c14efa-b71e-4a3c-8861-fe395b2deca4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 200 len: 1184 microversion: 2.1 time: 0.203791 Jun 23 11:07:51.827302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 369/746] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:51 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 1184 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:52.150801 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c56076a6-3d07-4236-857f-21ada24fbb12 req-e910a789-77b4-4ed5-93fa-61c1abad6e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4c91f8-2f76-436d-8b6c-0ab0945961d9", "name": "network-vif-deleted", "tag": "8b01f05d-725c-403a-b014-97986787465c"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:52.159817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c56076a6-3d07-4236-857f-21ada24fbb12 req-e910a789-77b4-4ed5-93fa-61c1abad6e47 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.160315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c56076a6-3d07-4236-857f-21ada24fbb12 req-e910a789-77b4-4ed5-93fa-61c1abad6e47 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.172778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c56076a6-3d07-4236-857f-21ada24fbb12 req-e910a789-77b4-4ed5-93fa-61c1abad6e47 service nova] Creating event network-vif-deleted:8b01f05d-725c-403a-b014-97986787465c for instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 on hv-cinder-84330 Jun 23 11:07:52.177689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c56076a6-3d07-4236-857f-21ada24fbb12 req-e910a789-77b4-4ed5-93fa-61c1abad6e47 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030938 Jun 23 11:07:52.178981 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 378/747] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:52.344832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-28dfc93b-390b-41df-8165-aa04266a0988 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: .version_select at 0x7f089c6a2940>, body: {"keypair": {"name": "tempest-keypair-828238568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBW7hT9HP1OLDSV7VOSQovX9rP1MLiy+Jfy9ay+yG6c6T67zikAsBg7SoAM6h2YVzD7jvSHoXRjlwn5I3LAEJeoq8DDatQQhBS26Fr0vaWSFo0wL1Y05gN84mB7vULf9Q=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:52.366037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-28dfc93b-390b-41df-8165-aa04266a0988 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:52.371341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-28dfc93b-390b-41df-8165-aa04266a0988 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for user 303e8aae1bd04228bedb145dec891a3e and project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:52.409530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-28dfc93b-390b-41df-8165-aa04266a0988 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069381 Jun 23 11:07:52.412798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 370/748] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:07:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:52.686289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:52.686995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:52.694633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.695594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.696759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.697341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.749208 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.751309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.752902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lazy-loading 'fault' on Instance uuid 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:07:52.818010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:52.827726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:52.838369 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:52.839889 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d667c97-96ff-45f0-b395-17216c7963f8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 200 len: 1369 microversion: 2.20 time: 0.160019 Jun 23 11:07:52.841378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 379/749] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:52 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:07:52.857745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:52.858614 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:52.866510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.867272 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.868190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.868789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.917748 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] HTTP exception thrown: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Request method failure captured: Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c HTTP/1.1 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiTs3EDFLedpTk3rElAAOIJxn-UfNxTeaIOWo6NQY87-0BbIhQZy3UrULU03Vif_77fqF8PADrAiw1xzoqQ6XbB_iCYTzn7vq-KSWsdWUkJ6ynNOI71W_fLQjdD_BbUEZMQc0ijEFz11dE9QSz4SxpLKwJeUQnxW7YGOBa8zvnq624 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:07:52.922463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1fccc592269f433b99c2d13dad5e8e39", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-TestVolumeBootPattern-998316529 Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 8f8da2142b9e4751b436cfd4920587a0 Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:07:52.924037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '6f49b10a-300a-4cca-bc81-35841bde257c'} Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:07:52.924924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:07:52.926367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:52.930748 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:52.931149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:52.931739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Returning 404 to user: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:07:52.932832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5a6ff0fd-483c-4409-8076-a3ac459c50e8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 404 len: 111 microversion: 2.1 time: 0.091215 Jun 23 11:07:52.934875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 371/750] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:52 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:07:52.940255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.940711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.941485 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:52.941919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:52.984677 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:07:53.108614 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-30dbcd13-660a-472f-910f-48d3c84d4906 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 204 len: 0 microversion: 2.1 time: 0.181601 Jun 23 11:07:53.110653 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 380/751] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:07:52 2022] DELETE /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:07:53.121115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1252405941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-789488599", "security_groups": [{"name": "tempest-secgroup-smoke-1647556123"}], "block_device_mapping_v2": [{"uuid": "5e3759df-4a38-4821-8d6d-5e001da6637f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c33ca82f-6e79-4afd-a43f-c1b68283a4eb"}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:53.123605 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:53.124726 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:53.132170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.132906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.134420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.135063 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.282935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] validate_networks() for [('c33ca82f-6e79-4afd-a43f-c1b68283a4eb', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:07:53.398539 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:53.406573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8310f7c1-806f-4f64-b997-09f2db6f4837 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1508 microversion: 2.1 time: 0.291255 Jun 23 11:07:53.407686 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 381/752] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:53 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:53.728423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:07:53.728899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:07:53.729308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:07:53.729717 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:07:53.730130 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:07:53.733312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:53.740923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.741376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.742293 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.742746 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.762529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:53.766551 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for user 8f8da2142b9e4751b436cfd4920587a0 and project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:53.823801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:07:53.825960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e3759df-4a38-4821-8d6d-5e001da6637f',volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:07:53.858390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:53.859702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:53.867059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.867781 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.868684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:53.869184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:53.885645 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] HTTP exception thrown: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Request method failure captured: Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 HTTP/1.1 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEiK2Dmn6GG8VGXTe-C11O4Y0KmEUNxcBj7BFmZjOtVVNkiu56D3IQUP0IPeaMPdaSr_8Uc9-m7Fe0E5tAvWlcQhw_ukuWBvToEvqbA5WhHm7QIIFypfzNxxMI69GT4dnyf-kTVtXN6mrMsnHsrMIBnWbMdec_10WYUIbdpkCSC_9UU Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:07:53.887354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/172a9e51095e47318b27881dab868355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_172a9e51095e47318b27881dab868355", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 94bcc16975124f728459d3c28b97f1a8 Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:07:53.889554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '9d4c91f8-2f76-436d-8b6c-0ab0945961d9'} Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:07:53.890407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:07:53.892070 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:07:53.894426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Returning 404 to user: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:07:53.894426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c3f13637-027a-45bd-9a70-eeca6d30fb8c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 404 len: 111 microversion: 2.20 time: 0.034323 Jun 23 11:07:53.894426 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 382/753] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:53 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 11:07:53.898584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-84623011-cafe-4e19-9549-ce2f7ec7ed42 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '.version_select at 0x7f089c63b040>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:53.919377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-84623011-cafe-4e19-9549-ce2f7ec7ed42 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960839918" status: 204 len: 0 microversion: 2.20 time: 0.024607 Jun 23 11:07:53.920013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 383/754] 10.222.0.65 () {60 vars in 1261 bytes} [Thu Jun 23 11:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960839918 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:07:53.973890 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1691340458", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f66c2d2-ea10-4014-ae5f-f902d520ab2d"}], "security_groups": [{"name": "tempest-securitygroup--1079715636"}], "key_name": "tempest-keypair-828238568", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:54.003682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-24906941-02d5-4429-8b4d-1c9f11d8479f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891738 Jun 23 11:07:54.017590 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 372/755] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:07:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:07:54.022645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b0a054c4-703c-46e4-92a4-6a2d37716948 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:54.023035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b0a054c4-703c-46e4-92a4-6a2d37716948 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:54.082769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b0a054c4-703c-46e4-92a4-6a2d37716948 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:54.095511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b0a054c4-703c-46e4-92a4-6a2d37716948 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1094 microversion: 2.1 time: 0.076762 Jun 23 11:07:54.097273 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 373/756] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:54 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:54.106308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] validate_networks() for [('2f66c2d2-ea10-4014-ae5f-f902d520ab2d', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:07:54.428083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:54.429106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:54.436086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:54.437082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:54.438229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:54.438864 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:54.595592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:07:54.596071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:07:54.596535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:07:54.596939 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:07:54.597342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:07:54.608730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:54.609400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:54.610348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:54.610980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:54.629546 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:54.633573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Getting quotas for user 303e8aae1bd04228bedb145dec891a3e and project ac9f9313c3ac4dde97e75ac6fa8fae11. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:54.669890 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:07:54.673458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:07:54.726633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7e7d047-5a3c-40d9-8801-ffaefaca2d65 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.758164 Jun 23 11:07:54.727275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 384/757] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:07:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:07:54.738753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df9a1570-9f19-4290-8d53-e1a73ebf497d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:54.739563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df9a1570-9f19-4290-8d53-e1a73ebf497d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:54.747258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:54.750302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:54.756348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9343cbe4-e194-46f4-9bf3-04db48d32690 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1508 microversion: 2.1 time: 0.336431 Jun 23 11:07:54.757084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 374/758] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:54 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1508 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:54.763001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c035ea71-4bbd-4352-83eb-25a1e04aa7a0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'create', calling method: .version_select at 0x7f089c6ed8b0>, body: {"keypair": {"name": "tempest-keypair-624205536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKezMZ3taQLxJEFr90Zd2AbVaBguL0C5i8+hAM2VZzqE4wEb84hTkxOx9z5CWNmlViC9tkilBrfZxj8dBrYWbtVYUNpuh/j/faC3RAZBjzt6XRI8vQqxEnTSO+7BHEFfzw=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:54.791333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-c035ea71-4bbd-4352-83eb-25a1e04aa7a0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for project 172a9e51095e47318b27881dab868355. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:54.796185 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-c035ea71-4bbd-4352-83eb-25a1e04aa7a0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for user 94bcc16975124f728459d3c28b97f1a8 and project 172a9e51095e47318b27881dab868355. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:54.807560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-df9a1570-9f19-4290-8d53-e1a73ebf497d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:54.815295 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df9a1570-9f19-4290-8d53-e1a73ebf497d tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1237 microversion: 2.1 time: 0.081770 Jun 23 11:07:54.816031 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 385/759] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:54 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:54.822129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c035ea71-4bbd-4352-83eb-25a1e04aa7a0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.064158 Jun 23 11:07:54.822647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 375/760] 10.222.0.65 () {62 vars in 1199 bytes} [Thu Jun 23 11:07:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 11:07:55.114401 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:55.115007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:55.121933 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.122415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.123306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.123840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.199965 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:55.209760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80718896-8578-4cec-9157-9cbfde370b6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1192 microversion: 2.1 time: 0.099579 Jun 23 11:07:55.220934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 386/761] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:55 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:55.780664 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:55.783405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:55.792925 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.793742 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.794738 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.795373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.832623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:55.833407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:55.846665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.847637 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.848577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:55.854203 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:55.886999 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:55.997628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:56.008309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe6588ee-799a-4959-8ff7-127e279b753c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1289 microversion: 2.1 time: 0.179799 Jun 23 11:07:56.008897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 387/762] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:55 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:56.021373 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:56.025794 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:56.032116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-15c210db-219a-4d04-842d-f0461d1b9517 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 200 len: 1466 microversion: 2.1 time: 0.258440 Jun 23 11:07:56.033239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 376/763] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:55 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 1466 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:56.078778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-db609c06-b68e-42e2-98ef-87ec2a98c11a req-ca8062d2-c6b4-48e8-b20b-40ed3f6df825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd22d66-6c09-4099-8205-5eec0effaeb6", "name": "network-vif-deleted", "tag": "9a1f5b7e-89bf-488e-990f-34a0baf9914f"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:56.094054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-db609c06-b68e-42e2-98ef-87ec2a98c11a req-ca8062d2-c6b4-48e8-b20b-40ed3f6df825 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:56.094054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-db609c06-b68e-42e2-98ef-87ec2a98c11a req-ca8062d2-c6b4-48e8-b20b-40ed3f6df825 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:56.108012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-db609c06-b68e-42e2-98ef-87ec2a98c11a req-ca8062d2-c6b4-48e8-b20b-40ed3f6df825 service nova] Creating event network-vif-deleted:9a1f5b7e-89bf-488e-990f-34a0baf9914f for instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 on hv-cinder-84330 Jun 23 11:07:56.126113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-db609c06-b68e-42e2-98ef-87ec2a98c11a req-ca8062d2-c6b4-48e8-b20b-40ed3f6df825 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051389 Jun 23 11:07:56.126785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 388/764] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:07:56.238465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:56.239099 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:56.246571 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:56.247102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:56.247988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:56.248501 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:56.314027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:56.321609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7b894e61-966e-461d-9f97-0fcd9ee6c40d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1210 microversion: 2.1 time: 0.087481 Jun 23 11:07:56.327646 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 377/765] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:56 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:57.027205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:57.027925 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:57.035322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.035814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.036585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.037022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.050972 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:57.052224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: 7bd22d66-6c09-4099-8205-5eec0effaeb6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:57.059503 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.059989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.060933 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.061604 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.077329 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] HTTP exception thrown: Instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 could not be found. Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Request method failure captured: Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 HTTP/1.1 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEg3iINLTSjOhWRw2HyLGSvSdbOBEFBaAq4FQvIugZYQsYteQvjoiPUsZO2Lo1Xct51UkJ5g4GqIPhT9BTOu6F30uw4peqpoHs_wZhBv5ySfgmZUc7qOnzP55VRXCeMhAIVQV9IWk787k55tp_M-MBaVmkM5-UcSMNjVq9aEvj7suH0 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:07:57.079426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d3db3ac9cb13453fa7bc8195bdf88fd1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 6bb5a1f18dff4395bec9c205a9937493 Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 could not be found. Jun 23 11:07:57.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '7bd22d66-6c09-4099-8205-5eec0effaeb6'} Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 could not be found. Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:07:57.081910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 could not be found. Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 could not be found. Jun 23 11:07:57.083359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:07:57.084633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Returning 404 to user: Instance 7bd22d66-6c09-4099-8205-5eec0effaeb6 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:07:57.084633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-84be5f8c-e0a2-48d0-9425-365afd1a9c6f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6" status: 404 len: 111 microversion: 2.1 time: 0.035714 Jun 23 11:07:57.084633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 378/766] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:57 2022] GET /compute/v2.1/servers/7bd22d66-6c09-4099-8205-5eec0effaeb6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:07:57.089182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:57.089680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:57.095987 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.096441 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.097224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.097666 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.126627 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:07:57.158408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:57.172124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-490bb8c7-00e6-4684-b8cb-ae832eb0b9ae tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1295 microversion: 2.1 time: 0.149499 Jun 23 11:07:57.173499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 389/767] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:57 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:57.224843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1269103713", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cde6b719-8052-4ec2-a733-c2d79d7cb320"}], "security_groups": [{"name": "tempest-securitygroup--1532571999"}], "key_name": "tempest-keypair-624205536", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:07:57.231823 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a2700385-2229-4c44-8389-ae3c0b07be41 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 204 len: 0 microversion: 2.1 time: 0.145388 Jun 23 11:07:57.235979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 379/768] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:07:57 2022] DELETE /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:07:57.242711 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:57.243431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:57.250909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.251315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.252155 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.252605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.388432 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:57.396959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f9b88036-3c75-4aff-8b5f-c28a780a451f tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.159282 Jun 23 11:07:57.397607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 380/769] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:57 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:57.402376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:57.403865 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:57.409923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] validate_networks() for [('cde6b719-8052-4ec2-a733-c2d79d7cb320', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:07:57.410605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.411131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.412016 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:57.412665 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:57.560796 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:57.569504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9c63402c-8df8-491a-b11e-89cc8c2f6e6a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1278 microversion: 2.1 time: 0.170838 Jun 23 11:07:57.570070 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 381/770] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:57 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:58.049770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:07:58.050191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:07:58.050659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:07:58.051109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:07:58.051682 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:07:58.062146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.063545 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.064376 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.064808 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.081922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for project 172a9e51095e47318b27881dab868355. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:07:58.085851 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Getting quotas for user 94bcc16975124f728459d3c28b97f1a8 and project 172a9e51095e47318b27881dab868355. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:07:58.096715 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:07:58.099018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:07:58.145587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fda11317-db41-4e44-8fda-bb34bdcfbe41 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.925919 Jun 23 11:07:58.146225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 390/771] 10.222.0.65 () {62 vars in 1187 bytes} [Thu Jun 23 11:07:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 11:07:58.156378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7a94a259-c26f-4716-8d14-5b2787c81c63 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:58.156985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7a94a259-c26f-4716-8d14-5b2787c81c63 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:58.190419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:58.191127 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:58.197459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.198019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.199036 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.200302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.217382 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7a94a259-c26f-4716-8d14-5b2787c81c63 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.225086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7a94a259-c26f-4716-8d14-5b2787c81c63 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.226588 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7a94a259-c26f-4716-8d14-5b2787c81c63 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.227945 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7a94a259-c26f-4716-8d14-5b2787c81c63 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1281 microversion: 2.20 time: 0.075401 Jun 23 11:07:58.228550 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 382/772] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:58 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:07:58.339180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.347853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c83983c5-443f-4192-b2b2-5f63c299aff0 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.162472 Jun 23 11:07:58.348443 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 391/773] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:58 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:07:58.414294 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:58.414899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:58.420870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.421320 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.422667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.423102 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.551808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.559207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-423a8a81-9094-4f4f-8ebf-07567b84d8aa tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.148647 Jun 23 11:07:58.559784 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 383/774] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:58 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:58.586222 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:58.586792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:58.592817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.593290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.594544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:58.594973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:58.720800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:58.728135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-996600ab-e5a4-4918-8d18-5546d7b91787 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1278 microversion: 2.1 time: 0.145818 Jun 23 11:07:58.728701 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 392/775] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:58 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:59.246310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:59.246911 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:59.253507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.253949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.254709 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.255141 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.315024 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:59.322813 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:59.324334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:59.325412 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a28c09fe-9eaf-4267-98ca-1da72c944e3e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1285 microversion: 2.20 time: 0.083040 Jun 23 11:07:59.325958 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 384/776] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:07:59 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:07:59.364840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:59.365450 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:59.371941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.372394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.373156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.373587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.518939 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:59.528594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-478ea8af-a9f8-44dd-b23c-72064192b271 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.167393 Jun 23 11:07:59.530108 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 393/777] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:59 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:59.576846 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:59.578557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:59.585418 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.586475 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.587520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.588232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.724842 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:07:59.732801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-89921fee-1210-4fc4-bc26-eb18098b0886 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1519 microversion: 2.1 time: 0.160133 Jun 23 11:07:59.733299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 385/778] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:59 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:07:59.745094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:07:59.745703 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:07:59.751949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.752395 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:07:59.753157 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:07:59.753588 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.124024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:00.132557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a27ae6e2-2253-4dbc-9f2b-077b3c57ca69 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1278 microversion: 2.1 time: 0.391400 Jun 23 11:08:00.133201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 394/779] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:07:59 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1278 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:00.343445 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:00.344668 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:00.365178 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.365562 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.366365 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.366805 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.374390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-1183fd9a-9984-4fc0-b358-b7d234794178 req-78474aaf-45db-435d-9bc3-dc1682481cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c6bdb0-09d8-496b-998a-c2a4252c5772", "name": "network-vif-deleted", "tag": "88802b38-9718-44af-a9c0-e377da1fdee6"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:00.390282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-1183fd9a-9984-4fc0-b358-b7d234794178 req-78474aaf-45db-435d-9bc3-dc1682481cb2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.391103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-1183fd9a-9984-4fc0-b358-b7d234794178 req-78474aaf-45db-435d-9bc3-dc1682481cb2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.411196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-1183fd9a-9984-4fc0-b358-b7d234794178 req-78474aaf-45db-435d-9bc3-dc1682481cb2 service nova] Creating event network-vif-deleted:88802b38-9718-44af-a9c0-e377da1fdee6 for instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 on hv-cinder-84330 Jun 23 11:08:00.419256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-1183fd9a-9984-4fc0-b358-b7d234794178 req-78474aaf-45db-435d-9bc3-dc1682481cb2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048338 Jun 23 11:08:00.419876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 395/780] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:00.472909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:00.486037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:00.487950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:00.489094 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6f4bcfea-bed3-4eb3-83b0-a28353ffb867 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1333 microversion: 2.20 time: 0.150135 Jun 23 11:08:00.489640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 386/781] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:00 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:00.555279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:00.557371 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:00.577305 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.578664 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.581904 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.584002 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.750305 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:00.751080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:00.758718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.759843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.762435 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.763361 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.831986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:00.834258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:00.834956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lazy-loading 'fault' on Instance uuid b4c6bdb0-09d8-496b-998a-c2a4252c5772 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:08:00.932490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb5a1f18dff4395bec9c205a9937493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3db3ac9cb13453fa7bc8195bdf88fd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:00.942301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cc74964e-7ad6-4940-a51c-be2cdb137817 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 200 len: 1310 microversion: 2.1 time: 0.196610 Jun 23 11:08:00.946008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 387/782] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:00 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 1310 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:01.090449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:01.091762 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:01.099087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.099225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.100114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.100623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.232738 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Invalid volume: volume 8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 is already attached to instances: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: POST /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments HTTP/1.1 Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 74 Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:08:01.235544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {"volumeAttachment": {"volumeId": "8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4"}} Jun 23 11:08:01.236928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Invalid volume: volume 8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 is already attached to instances: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'server_id': '3eed5440-b2dd-4413-84ff-fe74e9bdbf0d', 'body': {'volumeAttachment': {'volumeId': '8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4'}}} Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 is already attached to instances: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.237662 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 is already attached to instances: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:01.238785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:08:01.240347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:08:01.240347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:08:01.240347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:08:01.240347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 is already attached to instances: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d Jun 23 11:08:01.240347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.242747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 400 to user: Invalid volume: volume 8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 is already attached to instances: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:08:01.243942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a89eb180-f6ff-4a2a-8ace-8a5f8fa58fd3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.157616 Jun 23 11:08:01.245068 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 388/783] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:08:01 2022] POST /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments => generated 174 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 11:08:01.268352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:01.269080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:01.275964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.276428 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.277226 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.277667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.303577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:01.311741 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a938116f-6ea3-4ce6-a842-5bb3ae225741 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.768003 Jun 23 11:08:01.316692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 396/784] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:00 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:01.336091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ac0678ab-1185-47d6-9aa5-b4b8ab5c842c req-e58d4d2b-6654-4072-9148-7546b973ef10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a14dfc-929a-475c-ac07-48e81f7d53ba", "tag": "fb038df1-c7f3-4faa-ad6e-41cb0cd8c410"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:01.346197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ac0678ab-1185-47d6-9aa5-b4b8ab5c842c req-e58d4d2b-6654-4072-9148-7546b973ef10 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.346826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ac0678ab-1185-47d6-9aa5-b4b8ab5c842c req-e58d4d2b-6654-4072-9148-7546b973ef10 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.361113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ac0678ab-1185-47d6-9aa5-b4b8ab5c842c req-e58d4d2b-6654-4072-9148-7546b973ef10 service nova] Creating event network-changed:fb038df1-c7f3-4faa-ad6e-41cb0cd8c410 for instance a1a14dfc-929a-475c-ac07-48e81f7d53ba on hv-cinder-84330 Jun 23 11:08:01.370601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ac0678ab-1185-47d6-9aa5-b4b8ab5c842c req-e58d4d2b-6654-4072-9148-7546b973ef10 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052409 Jun 23 11:08:01.371594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 397/785] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:01.381304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:01.382610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:01.392753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.393460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.394499 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.395431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.616258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:01.627936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lazy-loading 'services' on Instance uuid 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:08:01.631135 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-587e5a37-7e76-4b81-8403-41eb9b79e0d7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1278 microversion: 2.1 time: 0.384781 Jun 23 11:08:01.639493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 389/786] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:01 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1278 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:01.645536 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:01.650020 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:01.666771 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.668559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.669405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.672744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.779191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-105fb172-7932-4971-a8c5-62d7709b37f6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments/8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4" status: 202 len: 0 microversion: 2.1 time: 0.405825 Jun 23 11:08:01.779813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 398/787] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:08:01 2022] DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments/8c0cfb07-84a4-4cca-a17e-6dfdca9e0ed4 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:08:01.788746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:01.789795 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:01.797840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.798288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.798629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:01.799053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.799480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.807426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:01.809076 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:01.810262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6963ab83-de2c-48ab-8373-7cc56e74cd0c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1339 microversion: 2.20 time: 0.169644 Jun 23 11:08:01.810906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 390/788] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:01 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:01.829399 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-884868ff-2523-4564-aee7-9c595634584d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Jun 23 11:08:01.829949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 399/789] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:08:01 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:01.961470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:01.962164 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] [instance: b4c6bdb0-09d8-496b-998a-c2a4252c5772] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:01.968392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.969530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.970368 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:01.971020 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:01.985440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] HTTP exception thrown: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 could not be found. Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Request method failure captured: Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 HTTP/1.1 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEg3iINLTSjOhWRw2HyLGSvSdbOBEFBaAq4FQvIugZYQsYteQvjoiPUsZO2Lo1Xct51UkJ5g4GqIPhT9BTOu6F30uw4peqpoHs_wZhBv5ySfgmZUc7qOnzP55VRXCeMhAIVQV9IWk787k55tp_M-MBaVmkM5-UcSMNjVq9aEvj7suH0 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:08:01.987198 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d3db3ac9cb13453fa7bc8195bdf88fd1", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d3db3ac9cb13453fa7bc8195bdf88fd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: d3db3ac9cb13453fa7bc8195bdf88fd1 Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2127021737 Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 6bb5a1f18dff4395bec9c205a9937493 Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2127021737-project Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 could not be found. Jun 23 11:08:01.988843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': 'b4c6bdb0-09d8-496b-998a-c2a4252c5772'} Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 could not be found. Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:08:01.989859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 could not be found. Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 could not be found. Jun 23 11:08:01.991339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:01.993408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] Returning 404 to user: Instance b4c6bdb0-09d8-496b-998a-c2a4252c5772 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:08:01.993408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3ac57eee-29de-48a3-b8ec-04e1ea89c6d8 tempest-ServerRescueNegativeTestJSON-2127021737 tempest-ServerRescueNegativeTestJSON-2127021737-project] 10.222.0.65 "GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772" status: 404 len: 111 microversion: 2.1 time: 0.030963 Jun 23 11:08:01.993408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 391/790] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:01 2022] GET /compute/v2.1/servers/b4c6bdb0-09d8-496b-998a-c2a4252c5772 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:08:02.331122 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:02.331893 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:02.339168 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.339611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.344794 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.345342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.647534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:02.649626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:02.650712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:02.660877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a48a4f05-036d-4d78-ae02-7f7732e6c947 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.333439 Jun 23 11:08:02.663178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 400/791] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:02 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:02.680123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.680977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.681950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.682490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.830494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:02.831230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:02.839080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.839530 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.840329 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.840768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.967942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:02.975820 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:02.977417 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:02.978509 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-849ae292-0eb0-4900-864c-b663a7069b7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.152708 Jun 23 11:08:02.979059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 401/792] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:02 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:02.983609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:02.984790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:02.990583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.991023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.991801 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:02.992226 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:02.993840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:03.003116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d932532b-60cf-46bd-87d2-edc201c0c30a tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.357981 Jun 23 11:08:03.003805 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 392/793] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:02 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:03.023719 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd531fd7-f4a1-498d-b0ba-f41fb65e9bd4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Jun 23 11:08:03.024520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 402/794] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:08:02 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:03.438912 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-985b264c-d724-4d44-a389-2ad07f32f9d9 req-451c4815-b87a-4802-b31e-614c9c4491a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f679b64b-da38-4e32-8565-0f30aa11496f", "tag": "84b1ad85-e16c-4985-8cbb-e7bf0a1823cc"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:03.447640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-985b264c-d724-4d44-a389-2ad07f32f9d9 req-451c4815-b87a-4802-b31e-614c9c4491a4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:03.448123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-985b264c-d724-4d44-a389-2ad07f32f9d9 req-451c4815-b87a-4802-b31e-614c9c4491a4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:03.459214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-985b264c-d724-4d44-a389-2ad07f32f9d9 req-451c4815-b87a-4802-b31e-614c9c4491a4 service nova] Creating event network-changed:84b1ad85-e16c-4985-8cbb-e7bf0a1823cc for instance f679b64b-da38-4e32-8565-0f30aa11496f on hv-cinder-84330 Jun 23 11:08:03.463990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-985b264c-d724-4d44-a389-2ad07f32f9d9 req-451c4815-b87a-4802-b31e-614c9c4491a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029403 Jun 23 11:08:03.464557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 393/795] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:03.602973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-6f75a5c7-5640-4189-ad88-b436ac0bc9a4 req-ee174645-1fd0-47e0-af87-73bd4289d2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:03.612369 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6f75a5c7-5640-4189-ad88-b436ac0bc9a4 req-ee174645-1fd0-47e0-af87-73bd4289d2b4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:03.613071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-6f75a5c7-5640-4189-ad88-b436ac0bc9a4 req-ee174645-1fd0-47e0-af87-73bd4289d2b4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:03.626291 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-6f75a5c7-5640-4189-ad88-b436ac0bc9a4 req-ee174645-1fd0-47e0-af87-73bd4289d2b4 service nova] Creating event network-changed:51cdb0e1-56be-4180-8c9e-d3a829c5bb64 for instance 248be1ac-b2c3-4081-adba-30258b95aa91 on hv-cinder-84330 Jun 23 11:08:03.631528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-6f75a5c7-5640-4189-ad88-b436ac0bc9a4 req-ee174645-1fd0-47e0-af87-73bd4289d2b4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Jun 23 11:08:03.632658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 403/796] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:03.681028 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:03.682342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:03.690498 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:03.691092 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:03.692254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:03.693165 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:03.731387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:03.750947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:03.997137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:03.997929 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:04.004789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.005331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.006354 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.006862 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.312986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:04.322992 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-37744403-baef-46f5-af2e-707cbe6f378c tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.646762 Jun 23 11:08:04.331502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 394/797] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:03 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:04.336600 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:04.337212 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:04.344149 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.344606 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.345377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.345815 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.486766 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:04.497232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:04.500375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:04.501506 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-08fe48b4-919d-44fc-a1ba-19605b5382a2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.508953 Jun 23 11:08:04.502225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 404/798] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:03 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:08:04.506907 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:04.508221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:04.522421 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.522876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.523647 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.524408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.555714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c5a173d7-799c-495e-bd91-186f10b2c333 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052262 Jun 23 11:08:04.556690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 405/799] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:08:04 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:08:04.620942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:04.621798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:04.629392 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.630535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.631554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.632227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.644216 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:04.671290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-58d43006-ab91-4255-acb9-cdd227525330 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.338373 Jun 23 11:08:04.673310 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 395/800] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:04 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:04.684921 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:08:04.688576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:04.776059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2f328dc5-1de4-4a31-9b8e-b49288b3e33a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 204 len: 0 microversion: 2.1 time: 0.158444 Jun 23 11:08:04.781543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 406/801] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:08:04 2022] DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:08:04.785849 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:04.786459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:04.792981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.793653 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.794426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:04.795018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:04.947140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:04.955623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-519cd802-e224-4a75-9016-4f0a4a703221 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1679 microversion: 2.1 time: 0.173649 Jun 23 11:08:04.956218 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 396/802] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:04 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:05.341190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:05.342638 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:05.349305 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.349944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.350702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.351509 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.524938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:05.526482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:05.535133 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.535882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.537009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.537717 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.581204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:05.589649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-031a3e5a-a9d5-4d4a-9912-676cab3a5756 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.252714 Jun 23 11:08:05.591137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 407/803] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:05 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:05.689470 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:05.690290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:05.699191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.699912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.700697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.701132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.713491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:05.722506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:05.724351 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:05.725567 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-85caa1ee-f9ae-4e14-93af-527bb8fc6231 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.208725 Jun 23 11:08:05.726220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 397/804] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:05 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:05.974568 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:05.976656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:05.984262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.985025 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:05.985855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:05.986293 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:06.007863 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:06.017657 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ed584e56-5628-44d1-8c05-e69901de2918 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.332598 Jun 23 11:08:06.018236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 408/805] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:05 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:06.150870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:06.159200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1c9d20f7-aead-4c1a-b659-b3e63673ffeb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1679 microversion: 2.1 time: 0.188560 Jun 23 11:08:06.159786 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 398/806] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:05 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:06.609052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:06.610138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:06.616879 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:06.617326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:06.618098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:06.618645 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:06.744295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:06.745082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:06.760647 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:06.761287 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:06.762109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:06.762917 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:06.905853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:06.915557 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-372bf42d-e1b4-4102-9fc7-82b918148a0e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.310733 Jun 23 11:08:06.916242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 409/807] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:06 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:06.991031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:07.005203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:07.007146 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:07.008312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-128c6145-5c27-46d8-88f2-a6f422800f64 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.267896 Jun 23 11:08:07.024889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 399/808] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:06 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:08:07.035167 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:07.036303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:07.043627 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.044368 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.045997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.047318 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.181994 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:07.183166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:07.192853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.193307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.194091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.194523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.268114 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:07.276138 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ea788d0-caf5-4845-ad5d-f6e63063fce8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.245654 Jun 23 11:08:07.276702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 410/809] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:07 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:07.389440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:07.398582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a626265c-d3c3-45ef-bac7-92d4bd7d75bc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1679 microversion: 2.1 time: 0.226021 Jun 23 11:08:07.399635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 400/810] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:07 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:07.912279 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a4e7c99d-c34f-414d-bbf7-1d3a43f4cc36 req-c2c6cbc7-0f01-44ed-bba0-ee82a7d30418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eed5440-b2dd-4413-84ff-fe74e9bdbf0d", "name": "network-vif-deleted", "tag": "4e4920d7-a569-4567-ba7e-9c995b534d53"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:07.923111 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a4e7c99d-c34f-414d-bbf7-1d3a43f4cc36 req-c2c6cbc7-0f01-44ed-bba0-ee82a7d30418 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.924498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a4e7c99d-c34f-414d-bbf7-1d3a43f4cc36 req-c2c6cbc7-0f01-44ed-bba0-ee82a7d30418 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.934241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:07.934940 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:07.943180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.943938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.945541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:07.947339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:07.950897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a4e7c99d-c34f-414d-bbf7-1d3a43f4cc36 req-c2c6cbc7-0f01-44ed-bba0-ee82a7d30418 service nova] Creating event network-vif-deleted:4e4920d7-a569-4567-ba7e-9c995b534d53 for instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d on hv-cinder-84330 Jun 23 11:08:07.957724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a4e7c99d-c34f-414d-bbf7-1d3a43f4cc36 req-c2c6cbc7-0f01-44ed-bba0-ee82a7d30418 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052896 Jun 23 11:08:07.958985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 411/811] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:08.028397 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:08.029073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:08.043397 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.044163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.051507 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.052238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.093900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:08.095290 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=14 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:08.199884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:08.209205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-110a38c4-e0e6-4df9-b0ad-ad342eb70f5e tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.279368 Jun 23 11:08:08.210291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 401/812] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:07 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:08.248379 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:08.257876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:08.261192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:08.262501 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d6b3d68-7459-40af-9ca7-8eddbba3cbdc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.238811 Jun 23 11:08:08.263622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 412/813] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:08 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:08.294170 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:08.294772 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:08.298450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=18 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:08.302340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.302957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.303907 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.304605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.419441 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:08.420162 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:08.436391 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.438680 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.439949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.440667 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.478793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:08.495722 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.496438 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.497123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lazy-loading 'fault' on Instance uuid 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:08:08.501905 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9b9f25da-90ff-44ba-90c9-21aa028baec4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.211840 Jun 23 11:08:08.502943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 402/814] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:08 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:08.553916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:08.564561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-54f87ade-9d93-41cd-8fcd-9c7e7f12144f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 200 len: 1330 microversion: 2.1 time: 0.150996 Jun 23 11:08:08.577556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 413/815] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:08 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 1330 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:08.867258 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-4e154d70-a0b4-4242-af71-5c8f8a27b1a8 req-6e7102bf-d074-4de0-849b-b7b756b076ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a14dfc-929a-475c-ac07-48e81f7d53ba", "name": "network-vif-plugged", "status": "completed", "tag": "fb038df1-c7f3-4faa-ad6e-41cb0cd8c410"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:08.879415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-4e154d70-a0b4-4242-af71-5c8f8a27b1a8 req-6e7102bf-d074-4de0-849b-b7b756b076ea service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:08.879900 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-4e154d70-a0b4-4242-af71-5c8f8a27b1a8 req-6e7102bf-d074-4de0-849b-b7b756b076ea service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:08.892008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-4e154d70-a0b4-4242-af71-5c8f8a27b1a8 req-6e7102bf-d074-4de0-849b-b7b756b076ea service nova] Creating event network-vif-plugged:fb038df1-c7f3-4faa-ad6e-41cb0cd8c410 for instance a1a14dfc-929a-475c-ac07-48e81f7d53ba on hv-cinder-84330 Jun 23 11:08:08.897001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-4e154d70-a0b4-4242-af71-5c8f8a27b1a8 req-6e7102bf-d074-4de0-849b-b7b756b076ea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.257961 Jun 23 11:08:08.897868 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 403/816] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:09.227143 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:09.227790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:09.236588 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.237029 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.237807 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.238241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.281947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:09.282560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:09.290853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.291302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.292100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.292774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.388556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:09.399449 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d0b3755f-4d36-4614-97a2-509d1c0af646 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.176083 Jun 23 11:08:09.399893 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 414/817] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:09 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:09.481480 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:09.496610 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:09.498179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:09.499347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-344a07f8-df1b-458f-9df4-863e23fbdb66 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.222292 Jun 23 11:08:09.500328 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 404/818] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:09 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:08:09.521773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:09.522944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:09.529288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.529943 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.530876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.532258 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.583490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:09.584190 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:09.591270 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:09.596774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.598316 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.599989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:09.601202 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:09.621467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d HTTP/1.1 Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:08:09.623346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:08:09.625496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '3eed5440-b2dd-4413-84ff-fe74e9bdbf0d'} Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:08:09.626437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:08:09.627997 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:08:09.631458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:08:09.632949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-77442635-8e66-4fe6-9b31-f08ee359f2dd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 404 len: 111 microversion: 2.1 time: 0.053669 Jun 23 11:08:09.639763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 405/819] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:09 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:08:09.646189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-750e37b3-cbc7-4ed4-a4f9-6e636fb0d1e4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '.version_select at 0x7f089c721af0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:09.671782 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-750e37b3-cbc7-4ed4-a4f9-6e636fb0d1e4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61419142" status: 202 len: 0 microversion: 2.1 time: 0.029913 Jun 23 11:08:09.673152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 406/820] 10.222.0.65 () {58 vars in 1214 bytes} [Thu Jun 23 11:08:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61419142 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:08:09.729144 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:09.740593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8c4eea33-5856-4eab-b99b-bd7ed3f012cb tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.223588 Jun 23 11:08:09.742106 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 415/821] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:09 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:10.278487 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6c643838-a6a4-47cd-8afe-14705b2e44df tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: .version_select at 0x7f089c6b6670>, body: {"keypair": {"name": "tempest-keypair-138776892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDna3QbJs0OBq30p4buDBrQZdJC17WBc/lxvtoOAX1E532CfjtGwegKdqglSsHli7mcqSnfAtd/ByK7aUgpR0LsouxsXUMPmaTCav+zGx+OMIVdqgZHZ+gOcuxZC+uAYg=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:10.293699 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-6c643838-a6a4-47cd-8afe-14705b2e44df tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:08:10.297460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-6c643838-a6a4-47cd-8afe-14705b2e44df tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:08:10.318823 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6c643838-a6a4-47cd-8afe-14705b2e44df tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044159 Jun 23 11:08:10.319334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 407/822] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:08:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:10.417205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:10.417810 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:10.424855 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:10.425300 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:10.426288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:10.426940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:10.518464 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:10.519081 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:10.525380 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:10.525830 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:10.526619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:10.527808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:10.571532 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:10.579902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4b24a4b0-28e8-4835-929c-f5629a5120dc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.166525 Jun 23 11:08:10.579902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 416/823] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:10 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:10.726127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:10.736846 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:10.738687 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:10.740084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6f790902-3ed1-40ff-99a0-de70bfc8f246 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.226213 Jun 23 11:08:10.740743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 408/824] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:10 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:08:10.758767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:10.759375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:10.766202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:10.766656 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:10.767421 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:10.768021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:10.912525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:10.920291 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cdf1ad5f-89bd-4e49-99ef-4e43034c6d71 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.165513 Jun 23 11:08:10.920858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 417/825] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:10 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:11.596858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:11.597573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:11.604073 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:11.604709 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:11.605534 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:11.606036 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:11.657648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1534342315", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b879fb0c-6f1b-457c-8797-97d9533d8257"}], "security_groups": [{"name": "tempest-securitygroup--157527283"}], "key_name": "tempest-keypair-138776892", "user_data": "}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:11.739282 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:11.747357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a8bcb325-cded-4e5a-afca-0b81bce9d5e1 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.154899 Jun 23 11:08:11.747948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 409/826] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:11 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:11.757975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:11.758373 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] validate_networks() for [('b879fb0c-6f1b-457c-8797-97d9533d8257', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:08:11.758889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:11.765931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:11.766442 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:11.767223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:11.767676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:11.899436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:11.908090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:11.909600 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:11.910701 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c170f441-ab1d-4812-9f8d-3e44380f01e1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.156521 Jun 23 11:08:11.911444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 410/827] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:11 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:08:11.938122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:11.938813 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:11.945097 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:11.945480 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:11.946253 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:11.946690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:12.083187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:12.090894 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4ec87dfe-2e9b-478c-bb9a-b94d46b890e5 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.156588 Jun 23 11:08:12.091884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 411/828] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:11 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:12.126967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:08:12.127379 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:08:12.127874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:08:12.128274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:08:12.128674 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:08:12.137501 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:12.137934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:12.138714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:12.139136 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:12.154952 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:08:12.159409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Getting quotas for user df7d511abd8544878e7d0097a1ab0319 and project 578cf1b29d474080a716e77fe2e84e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:08:12.161633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:12.172563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:08:12.174785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:08:12.220761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-43e4bc6e-1a3f-4be4-a6f9-69dac646d0bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.567959 Jun 23 11:08:12.221325 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 418/829] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:08:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:08:12.231206 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-254b5c6d-179d-48cd-b991-20e838f182d5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:12.231845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-254b5c6d-179d-48cd-b991-20e838f182d5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:12.287878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-254b5c6d-179d-48cd-b991-20e838f182d5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:12.294468 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-254b5c6d-179d-48cd-b991-20e838f182d5 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1241 microversion: 2.1 time: 0.067037 Jun 23 11:08:12.295023 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 412/830] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:12 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:12.764394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:12.765006 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:12.772361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:12.772803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:12.773562 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:12.773992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:12.905665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:12.913006 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3358c294-f164-4b4f-bb99-003dd029bc25 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1363 microversion: 2.1 time: 0.153324 Jun 23 11:08:12.913567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 419/831] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:12 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:12.929679 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:12.930291 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:12.937523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:12.938487 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:12.939262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:12.939750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.065009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:13.072876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:13.074387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:13.075485 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-275af2e6-ad33-47b9-82b3-d9c835d8ed03 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.149931 Jun 23 11:08:13.076067 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 413/832] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:12 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:13.109090 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:13.110219 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:13.116210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.116658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.117413 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.117846 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.242255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:13.249696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e4599b7-7154-432b-95d8-66141760a5e0 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.144474 Jun 23 11:08:13.250836 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 420/833] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:13 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:13.311164 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:13.311732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:13.318214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.318664 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.319430 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.319893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.381963 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:13.389446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a867c70e-2e1c-4a2f-9815-697616a400f2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1245 microversion: 2.1 time: 0.082255 Jun 23 11:08:13.390003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 414/834] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:13 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:13.785412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-83bef680-ba9d-4f9b-b5b6-dba3c01cfd90 req-d8afbf1d-c106-4213-9c14-2a4251e7f25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "name": "network-vif-plugged", "status": "completed", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:13.795991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-83bef680-ba9d-4f9b-b5b6-dba3c01cfd90 req-d8afbf1d-c106-4213-9c14-2a4251e7f25d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.797683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-83bef680-ba9d-4f9b-b5b6-dba3c01cfd90 req-d8afbf1d-c106-4213-9c14-2a4251e7f25d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.815042 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-83bef680-ba9d-4f9b-b5b6-dba3c01cfd90 req-d8afbf1d-c106-4213-9c14-2a4251e7f25d service nova] Creating event network-vif-plugged:51cdb0e1-56be-4180-8c9e-d3a829c5bb64 for instance 248be1ac-b2c3-4081-adba-30258b95aa91 on hv-cinder-84330 Jun 23 11:08:13.826200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-83bef680-ba9d-4f9b-b5b6-dba3c01cfd90 req-d8afbf1d-c106-4213-9c14-2a4251e7f25d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045513 Jun 23 11:08:13.827494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 421/835] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:13.932953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:13.933558 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:13.941454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.941906 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.942681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:13.943300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:13.962412 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:14.105707 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:14.106491 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:14.116909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:14.117332 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.117951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.121533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.121878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.128335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-148aa65a-5f15-4bfe-95e5-7800fe2af165 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1549 microversion: 2.1 time: 0.199233 Jun 23 11:08:14.129645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 415/836] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:13 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:14.147469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:14.147995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:14.154493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.154950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.155750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.156756 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.270371 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-78f6ed1b-fc41-4cd8-bfe0-d304d3a35429 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126629 Jun 23 11:08:14.270816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 416/837] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:08:14 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:14.285098 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:14.285240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:14.286151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:14.294063 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:14.296036 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:14.297573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a426fc8e-11e1-4bf8-a6eb-a2905df6d56d tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.198342 Jun 23 11:08:14.298512 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 422/838] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:14 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:14.300625 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.303492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.304629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.305568 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.407810 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:14.408562 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:14.417628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.427833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.428951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:14.429561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:14.451608 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:14.521693 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:14.529575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1daaf378-c0c7-4e59-8e17-9e86f2a471b4 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1293 microversion: 2.1 time: 0.126991 Jun 23 11:08:14.530137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 423/839] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:14 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:14.573075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:14.581120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8eddc1a0-cfb4-416f-a35a-5a4fdb0c16fe tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.302355 Jun 23 11:08:14.581698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 417/840] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:14 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:15.262153 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-b8d4486f-63d8-4484-8bf3-26eaab2f7416 req-15ed2d58-c7d2-4879-9585-afa26325c6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1a14dfc-929a-475c-ac07-48e81f7d53ba", "tag": "fb038df1-c7f3-4faa-ad6e-41cb0cd8c410"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:15.271322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b8d4486f-63d8-4484-8bf3-26eaab2f7416 req-15ed2d58-c7d2-4879-9585-afa26325c6e2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.271895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b8d4486f-63d8-4484-8bf3-26eaab2f7416 req-15ed2d58-c7d2-4879-9585-afa26325c6e2 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.283240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-b8d4486f-63d8-4484-8bf3-26eaab2f7416 req-15ed2d58-c7d2-4879-9585-afa26325c6e2 service nova] Creating event network-changed:fb038df1-c7f3-4faa-ad6e-41cb0cd8c410 for instance a1a14dfc-929a-475c-ac07-48e81f7d53ba on hv-cinder-84330 Jun 23 11:08:15.287971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-b8d4486f-63d8-4484-8bf3-26eaab2f7416 req-15ed2d58-c7d2-4879-9585-afa26325c6e2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029816 Jun 23 11:08:15.288553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 424/841] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:15.315445 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:15.316071 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:15.322447 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.322891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.323648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.324098 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.548041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:15.548973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:15.555296 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.556121 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.556898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.557323 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.624077 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:15.633054 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1b00f297-f90e-4ab7-b501-834639806cb1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1301 microversion: 2.1 time: 0.089468 Jun 23 11:08:15.634098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 425/842] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:15 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:15.642265 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:15.643183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:15.649583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.650147 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.651203 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:15.651921 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:15.717718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:15.725710 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:15.727203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:15.728337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2b6bc4b8-c935-413b-b779-43152e4d3774 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.416755 Jun 23 11:08:15.739301 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 418/843] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:15 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:15.791101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:15.799256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3b5391a4-7109-4c9d-97f2-44d22f245123 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.163749 Jun 23 11:08:15.799849 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 426/844] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:15 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:16.651129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:16.651676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:16.658110 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:16.658546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:16.659296 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:16.659753 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:16.718601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:16.725712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6b6a184e-15d0-4876-9ffd-42c386bc0a2f tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1301 microversion: 2.1 time: 0.078504 Jun 23 11:08:16.726259 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 419/845] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:16 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1301 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:16.746173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:16.746785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:16.754033 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:16.754478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:16.755239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:16.755691 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:16.815315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:16.815961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:16.822196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:16.822652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:16.823419 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:16.823883 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:16.882048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:16.890172 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:16.892268 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:16.893369 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d9b6ee9a-3ed2-44fe-93c2-4d83a9d8688b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.151138 Jun 23 11:08:16.893945 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 427/846] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:16 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:16.951371 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:16.959302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-226551b0-5c53-4648-8fae-8e043af18f1b tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.147828 Jun 23 11:08:16.959896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 420/847] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:16 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:17.742628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:17.743243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:17.750740 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.751392 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:17.751976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.752409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:17.779028 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-b7793594-7eac-4d22-a97a-a82ab362e8f5 req-68ec0ac8-c1e1-4494-8561-d9a961412294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f679b64b-da38-4e32-8565-0f30aa11496f", "name": "network-vif-plugged", "status": "completed", "tag": "84b1ad85-e16c-4985-8cbb-e7bf0a1823cc"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:17.790367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-b7793594-7eac-4d22-a97a-a82ab362e8f5 req-68ec0ac8-c1e1-4494-8561-d9a961412294 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.790825 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-b7793594-7eac-4d22-a97a-a82ab362e8f5 req-68ec0ac8-c1e1-4494-8561-d9a961412294 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:17.805722 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-b7793594-7eac-4d22-a97a-a82ab362e8f5 req-68ec0ac8-c1e1-4494-8561-d9a961412294 service nova] Creating event network-vif-plugged:84b1ad85-e16c-4985-8cbb-e7bf0a1823cc for instance f679b64b-da38-4e32-8565-0f30aa11496f on hv-cinder-84330 Jun 23 11:08:17.810915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-b7793594-7eac-4d22-a97a-a82ab362e8f5 req-68ec0ac8-c1e1-4494-8561-d9a961412294 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035945 Jun 23 11:08:17.811509 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 421/848] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:17.829512 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:17.836940 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21b55c42-1de7-4869-9c28-8978e3f641bf tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1311 microversion: 2.1 time: 0.098356 Jun 23 11:08:17.837481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 428/849] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:17 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:17.910922 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:17.911612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:17.919602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.920078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:17.920845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.921276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:17.980877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:17.981561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:17.988812 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.989335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:17.990217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:17.990753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:18.079510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:18.087641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:18.089183 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:18.090325 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7d253dc1-764c-4e1a-964a-b58a589f1f1b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1407 microversion: 2.20 time: 0.183587 Jun 23 11:08:18.091247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 422/850] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:17 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:18.280843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:18.288989 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cfe59dc8-8df5-4774-b665-0ba6d58436b4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.312518 Jun 23 11:08:18.289921 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 429/851] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:17 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:18.864629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:18.865405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:18.876991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:18.877459 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:18.879166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:18.879685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.070876 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:19.079096 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-365a310a-c5b9-4db9-a331-4cf9a6579d10 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.229017 Jun 23 11:08:19.080081 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 423/852] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:18 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:19.108602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:19.109249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:19.115829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.116283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.117049 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.117489 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.306576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:19.307327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:19.313359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.313807 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.314579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.315022 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.372309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:19.380533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:19.382104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:19.383265 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6991e189-9a64-44fa-a11f-ebd6ba80e485 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1598 microversion: 2.20 time: 0.278748 Jun 23 11:08:19.395738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 430/853] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:08:19 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1598 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:08:19.402017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:19.402505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:19.410024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.410475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.411232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.411686 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.466864 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:19.474943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c7fbc59a-c45e-45f8-a616-017682b33f59 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1266 microversion: 2.1 time: 0.172246 Jun 23 11:08:19.475506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 424/854] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:19 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:19.545120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d30d238e-1865-4de7-b309-2bf8929dcaf2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.147780 Jun 23 11:08:19.545915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 431/855] 10.222.0.65 () {60 vars in 1315 bytes} [Thu Jun 23 11:08:19 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:08:19.869769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-af38368f-cb37-47d6-8977-36ca8e2fb163 req-0f61c239-945a-4d63-a862-9cd67cd1155f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9081938b-1ccb-467a-bbbc-c2b2c1ddf599", "tag": "cf1e62a0-e03e-459d-a279-4ffbdae64ff6"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:19.878697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-af38368f-cb37-47d6-8977-36ca8e2fb163 req-0f61c239-945a-4d63-a862-9cd67cd1155f service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:19.881641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-af38368f-cb37-47d6-8977-36ca8e2fb163 req-0f61c239-945a-4d63-a862-9cd67cd1155f service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:19.900983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-af38368f-cb37-47d6-8977-36ca8e2fb163 req-0f61c239-945a-4d63-a862-9cd67cd1155f service nova] Creating event network-changed:cf1e62a0-e03e-459d-a279-4ffbdae64ff6 for instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 on hv-cinder-84330 Jun 23 11:08:19.910316 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-af38368f-cb37-47d6-8977-36ca8e2fb163 req-0f61c239-945a-4d63-a862-9cd67cd1155f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043947 Jun 23 11:08:19.910981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 425/856] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:20.108919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:20.110115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:20.118977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.119830 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.120759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.121344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.268498 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:20.275909 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f63856d6-13af-40a0-bc1b-cd618f6b0de1 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.175151 Jun 23 11:08:20.276471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 432/857] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:20 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:20.492125 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:20.492810 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:20.499158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.499609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.501100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.501541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.665969 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-42d9cabf-7d63-4faf-94ab-f3b769ce0bd8 req-d26d9eb7-2963-413b-aae5-0fabb9827a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:20.674777 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-42d9cabf-7d63-4faf-94ab-f3b769ce0bd8 req-d26d9eb7-2963-413b-aae5-0fabb9827a3a service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.675348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-42d9cabf-7d63-4faf-94ab-f3b769ce0bd8 req-d26d9eb7-2963-413b-aae5-0fabb9827a3a service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.692697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-42d9cabf-7d63-4faf-94ab-f3b769ce0bd8 req-d26d9eb7-2963-413b-aae5-0fabb9827a3a service nova] Creating event network-changed:51cdb0e1-56be-4180-8c9e-d3a829c5bb64 for instance 248be1ac-b2c3-4081-adba-30258b95aa91 on hv-cinder-84330 Jun 23 11:08:20.696227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:20.697897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-42d9cabf-7d63-4faf-94ab-f3b769ce0bd8 req-d26d9eb7-2963-413b-aae5-0fabb9827a3a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035602 Jun 23 11:08:20.698589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 433/858] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:20.704232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f3e6d042-ab0c-4d13-8b68-526e6ad058a1 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1454 microversion: 2.1 time: 0.216304 Jun 23 11:08:20.704824 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 426/859] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:20 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1454 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:20.720750 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:20.721385 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:20.727546 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.728048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.728812 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:20.729244 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:20.862984 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:20.870492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-423cf267-976c-4e5b-895a-4cab9e2ac095 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1454 microversion: 2.1 time: 0.153994 Jun 23 11:08:20.871065 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 434/860] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:20 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:21.292809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:21.293425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:21.300411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:21.301091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:21.301878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:21.302318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:21.532819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:21.541520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-036c12fe-1b5c-4cb0-9bca-cf5693ee270c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.252626 Jun 23 11:08:21.542083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 427/861] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:21 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:22.558643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:22.559998 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:22.563107 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:22.563997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:22.570619 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:22.571302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:22.572282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:22.572878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:22.706633 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:22.713197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-c78f854a-b181-4657-8282-afe00df9a0d4 req-8c722787-aea1-4ad5-aedc-6d7367704cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f679b64b-da38-4e32-8565-0f30aa11496f", "tag": "84b1ad85-e16c-4985-8cbb-e7bf0a1823cc"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:22.718979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=6 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:22.722906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6d724f5c-31ff-4541-af0e-a5c0b388c620 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.168311 Jun 23 11:08:22.723480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 435/862] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:22 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:22.727344 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-c78f854a-b181-4657-8282-afe00df9a0d4 req-8c722787-aea1-4ad5-aedc-6d7367704cbc service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:22.727892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-c78f854a-b181-4657-8282-afe00df9a0d4 req-8c722787-aea1-4ad5-aedc-6d7367704cbc service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:22.741025 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-c78f854a-b181-4657-8282-afe00df9a0d4 req-8c722787-aea1-4ad5-aedc-6d7367704cbc service nova] Creating event network-changed:84b1ad85-e16c-4985-8cbb-e7bf0a1823cc for instance f679b64b-da38-4e32-8565-0f30aa11496f on hv-cinder-84330 Jun 23 11:08:22.745964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-c78f854a-b181-4657-8282-afe00df9a0d4 req-8c722787-aea1-4ad5-aedc-6d7367704cbc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036464 Jun 23 11:08:22.746548 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 428/863] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:08:23.740753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:23.741287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:23.751303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:23.752118 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:23.753227 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:23.753833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:23.973252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:23.980997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3f151826-66bb-4df3-8cca-99f690a72f69 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.244231 Jun 23 11:08:23.981646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 436/864] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:23 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:24.999962 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:25.001346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:25.007874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:25.008339 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:25.009216 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:25.009733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:25.144421 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:25.152090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e542814d-f33c-4716-a063-7d9666a0fbc6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.157104 Jun 23 11:08:25.152652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 429/865] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:24 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:08:26.169059 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:26.169668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:26.175993 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:26.176443 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:26.177195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:26.177629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:26.513980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:26.521934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-db388107-c071-4417-9dbc-ce04503bdd6b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.356722 Jun 23 11:08:26.522488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 437/866] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:26 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:27.538969 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:27.539583 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:27.545810 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:27.546257 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:27.547017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:27.547454 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:27.677882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:27.685299 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1a12de9b-eee8-4998-b9d0-3c0f1ae5d18c tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.150504 Jun 23 11:08:27.685858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 430/867] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:27 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:28.701923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:28.702537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:28.709651 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:28.710101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:28.710866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:28.711301 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:28.839636 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:28.846932 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73f2e4f8-ca47-45c7-a34f-a96141a289eb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.148922 Jun 23 11:08:28.847492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 438/868] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:28 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:29.864638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:29.865333 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:29.871634 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:29.872106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:29.872870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:29.873304 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:30.004433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:30.012044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b46e520b-ffb4-4a37-b77b-8d8f45fed37b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.151139 Jun 23 11:08:30.012601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 431/869] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:29 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:30.821596 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ade61173-6a5a-4147-8e70-72839b76d131 req-6f7901c0-cbe3-4f04-957b-c26e4d8efb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9081938b-1ccb-467a-bbbc-c2b2c1ddf599", "name": "network-vif-plugged", "status": "completed", "tag": "cf1e62a0-e03e-459d-a279-4ffbdae64ff6"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:30.830735 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ade61173-6a5a-4147-8e70-72839b76d131 req-6f7901c0-cbe3-4f04-957b-c26e4d8efb7e service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:30.831304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ade61173-6a5a-4147-8e70-72839b76d131 req-6f7901c0-cbe3-4f04-957b-c26e4d8efb7e service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:30.842926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ade61173-6a5a-4147-8e70-72839b76d131 req-6f7901c0-cbe3-4f04-957b-c26e4d8efb7e service nova] Creating event network-vif-plugged:cf1e62a0-e03e-459d-a279-4ffbdae64ff6 for instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 on hv-cinder-84330 Jun 23 11:08:30.849289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ade61173-6a5a-4147-8e70-72839b76d131 req-6f7901c0-cbe3-4f04-957b-c26e4d8efb7e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031245 Jun 23 11:08:30.850342 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 439/870] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:31.030495 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:31.031086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:31.038251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:31.040233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:31.041042 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:31.041480 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:31.191036 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:31.199142 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-baf80f50-231c-4208-b1d1-dcef384203a6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.172712 Jun 23 11:08:31.199891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 432/871] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:31 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:32.216692 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:32.217384 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:32.224622 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:32.225058 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:32.225804 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:32.226231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:32.351414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:32.358750 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e7d052dd-a4a3-48a0-aae3-8e5a78217797 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.146243 Jun 23 11:08:32.359301 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 440/872] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:32 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:33.375721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:33.376358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:33.382815 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:33.383260 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:33.384054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:33.384483 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:33.514182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:33.522173 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-42a2950e-4b22-4cb1-8214-ea235e4b997a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.150303 Jun 23 11:08:33.522728 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 433/873] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:33 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:34.538760 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:34.539372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:34.545987 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:34.546435 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:34.547193 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:34.547627 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:34.677563 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:34.685223 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ea6a5890-4b0b-4b0a-b94e-8cfedb6e1c8d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1366 microversion: 2.1 time: 0.150309 Jun 23 11:08:34.685782 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 441/874] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:34 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:35.702004 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:35.702616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:35.710119 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:35.710575 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:35.711358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:35.711825 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:35.730554 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=100 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:35.839263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:08:35.846916 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-825233f8-09eb-4bf1-9de3-eb5a02150bcc tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1556 microversion: 2.1 time: 0.148794 Jun 23 11:08:35.847505 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 434/875] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:08:35 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:08:35.862805 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:35.863272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:35.869759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:35.870201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:35.870953 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:35.871385 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:35.888267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:35.948243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0ddfd21e-e529-45a6-ade7-90e09095a2fd tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089163 Jun 23 11:08:35.948826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 442/876] 10.222.0.65 () {58 vars in 1274 bytes} [Thu Jun 23 11:08:35 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:36.869737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-a93d3fbc-0566-4b6b-99dc-bdf9704d2f3a req-ec0dfabc-2c5b-4d2b-8a34-607eebad81d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9081938b-1ccb-467a-bbbc-c2b2c1ddf599", "tag": "cf1e62a0-e03e-459d-a279-4ffbdae64ff6"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:08:36.878538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-a93d3fbc-0566-4b6b-99dc-bdf9704d2f3a req-ec0dfabc-2c5b-4d2b-8a34-607eebad81d4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:36.878986 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-a93d3fbc-0566-4b6b-99dc-bdf9704d2f3a req-ec0dfabc-2c5b-4d2b-8a34-607eebad81d4 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:36.890276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-a93d3fbc-0566-4b6b-99dc-bdf9704d2f3a req-ec0dfabc-2c5b-4d2b-8a34-607eebad81d4 service nova] Creating event network-changed:cf1e62a0-e03e-459d-a279-4ffbdae64ff6 for instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 on hv-cinder-84330 Jun 23 11:08:36.896398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-a93d3fbc-0566-4b6b-99dc-bdf9704d2f3a req-ec0dfabc-2c5b-4d2b-8a34-607eebad81d4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030741 Jun 23 11:08:36.897703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 435/877] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:08:58.798721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:58.803177 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:08:58.803682 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:08:58.810868 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:58.811320 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:58.812110 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:08:58.812546 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:08:58.835537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-83e2dd7d-9285-43af-bfe1-a4ffbd9536ad tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/ips" status: 200 len: 146 microversion: 2.1 time: 0.038319 Jun 23 11:08:58.836125 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 443/878] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:08:58 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:02.236960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e70337f8-d867-4a8c-9c1a-40fc02d941cd"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:02.238095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:02.240237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:02.240874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=4 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:02.247878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:02.248323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:02.249078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:02.249510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:02.500991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-63503633-e05b-429a-a7c7-3eb1a3ee3279 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268342 Jun 23 11:09:02.501681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 436/879] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:09:02 2022] POST /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:04.205598 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:04.206091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:04.212635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:04.213076 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:04.213824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:04.214252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:04.236146 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fe058aac-2f6d-403c-af2e-da624371eae2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/ips" status: 200 len: 151 microversion: 2.20 time: 0.192986 Jun 23 11:09:04.236676 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 444/880] 10.222.0.65 () {60 vars in 1288 bytes} [Thu Jun 23 11:09:04 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/ips => generated 151 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:09:06.145368 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:06.146020 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:06.152686 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:06.153137 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:06.153888 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:06.154321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:06.176968 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lazy-loading 'flavor' on Instance uuid 248be1ac-b2c3-4081-adba-30258b95aa91 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:09:06.435975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-37c197f4-30c2-4949-8737-3e6c1d7a3332 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/action" status: 202 len: 0 microversion: 2.20 time: 0.295118 Jun 23 11:09:06.436583 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 437/881] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Jun 23 11:09:06 2022] POST /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:09:06.444813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:06.445932 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:06.452357 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:06.452814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:06.453628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:06.454066 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:06.580536 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:06.589189 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:06.590742 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:06.591937 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cc557f73-f245-486e-b7a2-6adfe050d7c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.151019 Jun 23 11:09:06.592494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 445/882] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:06 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:07.611267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:07.612053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:07.618283 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:07.618731 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:07.619492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:07.619961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:07.746690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:07.754618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:07.756197 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:07.757344 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9bf472b8-2dbc-478e-bcf0-bc46bd6abf75 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.150846 Jun 23 11:09:07.757931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 438/883] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:07 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:08.776012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:08.776609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:08.783020 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:08.783461 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:08.784246 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:08.784673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:08.918316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:08.926280 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:08.927840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:08.928973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ee53230f-70b2-4993-8754-1a554496793f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.156864 Jun 23 11:09:08.929524 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 446/884] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:08 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:09.948504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:09.949109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:09.955483 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:09.955988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:09.956759 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:09.957169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:10.087744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:10.095962 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:10.097464 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:10.098607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-138c32fe-d3e1-4981-aa5f-45ece1cf7b6e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.154827 Jun 23 11:09:10.099152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 439/885] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:09 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:11.041871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:11.042843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:11.049310 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:11.049747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:11.050492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:11.050917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:11.079308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f6d70138-3c42-453f-9996-ff9384ba2944 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041899 Jun 23 11:09:11.079889 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 447/886] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:11 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:11.089950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:11.090498 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:11.098014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:11.098014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:11.098777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:11.099213 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:11.118057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:11.118665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:11.124660 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:11.125101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:11.125863 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:11.126297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:11.128926 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-99ce1252-688d-431e-b402-7af35e243690 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/e70337f8-d867-4a8c-9c1a-40fc02d941cd" status: 200 len: 194 microversion: 2.1 time: 0.043026 Jun 23 11:09:11.129508 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 440/887] 10.222.0.65 () {58 vars in 1412 bytes} [Thu Jun 23 11:09:11 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/e70337f8-d867-4a8c-9c1a-40fc02d941cd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:11.261730 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:11.270453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:11.272102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:11.273873 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-74325d5a-48ed-4cbd-b86e-148a82226eb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.159894 Jun 23 11:09:11.274810 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 448/888] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:11 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:12.291908 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:12.292602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:12.299260 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:12.299767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:12.300556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:12.300994 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:12.430961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:12.439920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:12.441416 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:12.442553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d2b03b60-10ec-4bf3-b6bc-28def8d18573 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.154758 Jun 23 11:09:12.443082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 441/889] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:12 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:12.451288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e5140f5-2b0c-47bb-90de-9d07438ebd36"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:12.452382 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:12.458755 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:12.459205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:12.459991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:12.460419 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:12.713556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-487dfbcf-8586-4295-98a2-cae1bd319877 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "POST /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266031 Jun 23 11:09:12.714158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 449/890] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:09:12 2022] POST /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:13.460649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:13.462513 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:13.469072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:13.469523 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:13.470425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:13.470881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:13.630600 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:13.639978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:13.641785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:13.643009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-654a93ff-7142-4c34-ad45-ae1d6fbc2d7a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.186521 Jun 23 11:09:13.643832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 442/891] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:13 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:14.663213 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:14.664497 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:14.671000 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:14.671543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:14.672402 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:14.672833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:14.818331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:14.827403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:14.829036 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:14.830130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c39386b2-6494-4e3c-8edf-382dd4d9ce29 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.172237 Jun 23 11:09:14.831161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 450/892] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:14 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:15.849051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:15.849578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:15.856629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:15.857086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:15.857859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:15.858300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:15.988924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:15.998271 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:15.999788 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:16.000978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-81076620-b48d-4bbd-8148-61f63ce87619 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.155896 Jun 23 11:09:16.001772 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 443/893] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:15 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:17.019678 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:17.020283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:17.027307 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:17.027789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:17.028547 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:17.028979 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:17.165232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:17.173073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:17.174623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:17.175792 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab513e0a-2f9c-4d3d-a4a5-cc74c8878695 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.160077 Jun 23 11:09:17.176350 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 451/894] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:17 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:18.194276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:18.194882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:18.202170 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:18.202669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:18.204074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:18.204074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:18.335509 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:18.343347 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:18.344905 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:18.346049 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a6bdd2bf-6023-4291-9fbc-95ba49dd17c6 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.155668 Jun 23 11:09:18.346596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 444/895] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:18 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:19.365400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:19.365950 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:19.372991 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:19.373435 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:19.374245 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:19.374680 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:19.500449 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:19.508282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:19.509832 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:19.510987 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0e6484aa-04d3-43f5-b081-d2f965c9a9eb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.149900 Jun 23 11:09:19.511543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 452/896] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:19 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:20.208082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:20.209052 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:20.215792 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.216237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.217001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.217502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.247300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ae0cd3a3-f323-4252-909f-725d59cb55fc tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043090 Jun 23 11:09:20.247868 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 445/897] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:20 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:20.404414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:20.404937 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:20.411331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.411843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.412612 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.413924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.442461 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-324d8638-a014-4bd7-a929-292c676104b8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/e70337f8-d867-4a8c-9c1a-40fc02d941cd" status: 200 len: 194 microversion: 2.1 time: 0.042239 Jun 23 11:09:20.443036 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 453/898] 10.222.0.65 () {58 vars in 1412 bytes} [Thu Jun 23 11:09:20 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/e70337f8-d867-4a8c-9c1a-40fc02d941cd => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:20.453150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:20.453673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:20.459581 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.460077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.460843 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.461322 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.531440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:20.532082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:20.538109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.538552 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.539303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:20.539783 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:20.541931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lazy-loading 'services' on Instance uuid a1a14dfc-929a-475c-ac07-48e81f7d53ba {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:09:20.615106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-07da0b08-6531-40d7-9d03-55464679b58f tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/e70337f8-d867-4a8c-9c1a-40fc02d941cd" status: 202 len: 0 microversion: 2.1 time: 0.165580 Jun 23 11:09:20.616201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 446/899] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:09:20 2022] DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/e70337f8-d867-4a8c-9c1a-40fc02d941cd => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:09:20.687582 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:20.696052 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:20.697599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:20.698744 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d047c154-f8e4-485f-bf2f-40c65b83497b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.171168 Jun 23 11:09:20.699297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 454/900] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:20 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:21.717321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:21.718147 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:21.725426 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:21.725951 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:21.726797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:21.727349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:21.857159 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:21.865358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:21.866881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:21.868592 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4f8faa64-36ce-4172-adf0-dde8c6562e8e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.155176 Jun 23 11:09:21.869143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 447/901] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:21 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:22.783990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:22.784574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:22.791482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:22.791962 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:22.792745 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:22.793182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:22.822999 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e4dffd31-48bb-40ec-9f96-5371c7813e36 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/2e5140f5-2b0c-47bb-90de-9d07438ebd36" status: 200 len: 194 microversion: 2.1 time: 0.042679 Jun 23 11:09:22.823567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 455/902] 10.222.0.65 () {58 vars in 1412 bytes} [Thu Jun 23 11:09:22 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/2e5140f5-2b0c-47bb-90de-9d07438ebd36 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:22.833189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:22.833682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:22.840231 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:22.840676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:22.841440 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:22.841878 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:22.859516 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:22.887174 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:22.887800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:22.894253 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:22.894694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:22.895445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:22.895907 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:22.927576 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lazy-loading 'services' on Instance uuid a1a14dfc-929a-475c-ac07-48e81f7d53ba {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:09:23.010615 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-14e3216f-3749-4706-9b34-7e0906d80c03 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/2e5140f5-2b0c-47bb-90de-9d07438ebd36" status: 202 len: 0 microversion: 2.1 time: 0.181080 Jun 23 11:09:23.011520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 448/903] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:09:22 2022] DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments/2e5140f5-2b0c-47bb-90de-9d07438ebd36 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:09:23.035190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:23.044935 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:23.057854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:23.060456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-35690ba3-79cc-4358-8cbc-00a78068c16e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1744 microversion: 2.20 time: 0.177500 Jun 23 11:09:23.064135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 456/904] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:22 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:24.079300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:24.080018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:24.089106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:24.089850 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:24.090804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:24.091415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:24.237645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:24.246444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:24.248081 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:24.249290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1c40fe75-6157-43ee-8c6e-49d02641a0bf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1744 microversion: 2.20 time: 0.174204 Jun 23 11:09:24.249836 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 449/905] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:24 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:24.490866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:24.491407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:24.497832 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:24.498275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:24.499064 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:24.499496 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:24.522592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-da08e30c-9394-410c-bc3f-6e55579d8808 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/ips" status: 200 len: 149 microversion: 2.1 time: 0.035612 Jun 23 11:09:24.523137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 457/906] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:09:24 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:25.110290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-ecc04214-1679-44ab-9475-26fbca4e13be req-40c26be4-8d7c-4f4a-9a44-963fe73e54f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "name": "network-vif-plugged", "status": "completed", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:25.122445 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-ecc04214-1679-44ab-9475-26fbca4e13be req-40c26be4-8d7c-4f4a-9a44-963fe73e54f8 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.123021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-ecc04214-1679-44ab-9475-26fbca4e13be req-40c26be4-8d7c-4f4a-9a44-963fe73e54f8 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.135598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-ecc04214-1679-44ab-9475-26fbca4e13be req-40c26be4-8d7c-4f4a-9a44-963fe73e54f8 service nova] Creating event network-vif-plugged:51cdb0e1-56be-4180-8c9e-d3a829c5bb64 for instance 248be1ac-b2c3-4081-adba-30258b95aa91 on hv-cinder-84330 Jun 23 11:09:25.141603 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-ecc04214-1679-44ab-9475-26fbca4e13be req-40c26be4-8d7c-4f4a-9a44-963fe73e54f8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036415 Jun 23 11:09:25.142282 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 450/907] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:09:25.261787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:25.262993 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:25.269845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.270388 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.271238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.271815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.278961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:25.282349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:25.289709 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.290419 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.291834 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.292563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.303282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a36044be-7bf9-4232-9e45-567a334df2a9 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046206 Jun 23 11:09:25.304056 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 458/908] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:25 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:09:25.423364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:25.425076 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:25.432813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.442495 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.444839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.453326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.458360 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:25.464918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:25.475104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:25.477105 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:25.478915 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-210747f4-28cc-4828-8e2f-2de52d5e7df7 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.205577 Jun 23 11:09:25.479460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 451/909] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:25 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:25.516031 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-bbc929ed-66ed-4765-97a3-c74dfff636b3 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097959 Jun 23 11:09:25.517698 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 459/910] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:25 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:09:25.599433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:25.599950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:25.606961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.607410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.608212 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.608840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.635573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:09:25.742909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6bf36f3c-6592-47ed-8276-2f8b145709db tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 204 len: 0 microversion: 2.1 time: 0.146890 Jun 23 11:09:25.752607 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:25.753332 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:25.759980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.760303 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 452/911] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:25 2022] DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:09:25.761455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.762415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.763007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.850656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "463dddc1-471a-4710-97dd-acede617c2c7"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:25.851970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:25.859140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.860378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.860656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:25.861082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:25.942313 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:25.951404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cc6710f-81b4-403f-9edd-3d13cfa37cbf tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1674 microversion: 2.1 time: 0.202655 Jun 23 11:09:25.963749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 460/912] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:25 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:26.498462 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:26.499137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:26.506551 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:26.507199 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:26.508071 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:26.508567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:26.660718 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:26.670178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:26.671816 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:26.673131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cbe6c5ef-ed6a-4e66-a846-c574e3460daf tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.178777 Jun 23 11:09:26.674838 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 461/913] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:26 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:26.969713 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:26.970327 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:26.977186 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:26.977843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:26.979373 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:26.980026 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:27.127403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:27.136629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4566e339-ed2d-4980-9e05-6fb5d0de19f8 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1674 microversion: 2.1 time: 0.171356 Jun 23 11:09:27.137422 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 462/914] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:26 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:27.693483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:27.694222 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:27.702348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:27.703186 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:27.704235 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:27.704907 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:27.869490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8ef21b40-8b05-47f2-9364-1e772cdb6ab6 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "POST /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.024855 Jun 23 11:09:27.871580 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 453/915] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:09:25 2022] POST /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments => generated 194 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:27.900716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:27.912844 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:27.915018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:27.917141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-16cb9fad-9b60-4841-a593-a29648ed5311 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.227639 Jun 23 11:09:27.918232 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 463/916] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:27 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:28.156725 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:28.157712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:28.166484 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:28.167638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:28.169007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:28.171465 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:28.423978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:28.433210 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0493ae3a-e1d6-48bd-b9ab-f2d43047e951 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1674 microversion: 2.1 time: 0.283573 Jun 23 11:09:28.434557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 454/917] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:28 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1674 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:28.937231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:28.938411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:28.944051 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=43 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:28.948908 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:28.949586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:28.950514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:28.951097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:29.266083 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:29.279689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:29.281526 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:29.282453 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2ae7c3d6-2a66-443a-8b10-a21b04e315d1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.350781 Jun 23 11:09:29.293864 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 464/918] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:28 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:29.453860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:29.454424 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:29.467246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:29.467721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:29.468501 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:29.468927 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:29.470158 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-f023e7af-b00b-475a-9cfc-638a46b65f94 req-021e0a29-ac37-4fa9-98cc-eef772e59bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1a14dfc-929a-475c-ac07-48e81f7d53ba", "name": "network-vif-deleted", "tag": "fb038df1-c7f3-4faa-ad6e-41cb0cd8c410"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:29.479312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f023e7af-b00b-475a-9cfc-638a46b65f94 req-021e0a29-ac37-4fa9-98cc-eef772e59bc5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:29.480060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-f023e7af-b00b-475a-9cfc-638a46b65f94 req-021e0a29-ac37-4fa9-98cc-eef772e59bc5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:29.495577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-f023e7af-b00b-475a-9cfc-638a46b65f94 req-021e0a29-ac37-4fa9-98cc-eef772e59bc5 service nova] Creating event network-vif-deleted:fb038df1-c7f3-4faa-ad6e-41cb0cd8c410 for instance a1a14dfc-929a-475c-ac07-48e81f7d53ba on hv-cinder-84330 Jun 23 11:09:29.510863 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-f023e7af-b00b-475a-9cfc-638a46b65f94 req-021e0a29-ac37-4fa9-98cc-eef772e59bc5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044747 Jun 23 11:09:29.515029 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 465/919] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:09:29.590037 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303e8aae1bd04228bedb145dec891a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f9313c3ac4dde97e75ac6fa8fae11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:29.601864 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fa2ca985-fff2-4cef-8a2b-addf203e3211 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 200 len: 1606 microversion: 2.1 time: 0.155305 Jun 23 11:09:29.602815 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 455/920] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:29 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 1606 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:30.303035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:30.303780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:30.313910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:30.314429 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:30.315278 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:30.315796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:30.475314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:30.484196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:30.486137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:30.487347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-baa9d3e9-fb3c-4b28-a744-84f2601c73bb tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.189718 Jun 23 11:09:30.488108 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 466/921] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:30 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:30.621031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:30.622456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:30.629606 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:30.630048 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:30.630821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:30.631249 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:30.649361 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] HTTP exception thrown: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Request method failure captured: Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba HTTP/1.1 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEg2ZrjJvdQQCsoWQKA0NrSTZ0XXIRUelnfDYETx8ssH1dzLuWqsg66LvXdwVpZ_JXY7dw2oyX5ncZKgeMfQhlPFjG3P6nsDZ-7Rl2MdVIlM8kYzQnReHHgafXPZ9HPCu-B4Z-aQ3YqluwtpCR2VgwEWRkHqHXAI6CX_y0y3zObTRx8 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:30.652184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ac9f9313c3ac4dde97e75ac6fa8fae11", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 303e8aae1bd04228bedb145dec891a3e Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:30.653639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': 'a1a14dfc-929a-475c-ac07-48e81f7d53ba'} Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:30.654403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:30.655721 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:30.663781 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Returning 404 to user: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:30.664983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0cccc853-56f7-4d0c-9a45-e9eb0a47073a tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 404 len: 111 microversion: 2.1 time: 0.049394 Jun 23 11:09:30.670641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 456/922] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:30 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:30.676293 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ef3d4af3-d610-42e5-ab9c-0a95a526b894 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '.version_select at 0x7f089c7f5430>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:30.700695 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ef3d4af3-d610-42e5-ab9c-0a95a526b894 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828238568" status: 202 len: 0 microversion: 2.1 time: 0.028515 Jun 23 11:09:30.704779 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 467/923] 10.222.0.65 () {58 vars in 1217 bytes} [Thu Jun 23 11:09:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828238568 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:09:31.505883 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:31.506540 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:31.512735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:31.513200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:31.514246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:31.514715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:31.639823 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:31.648493 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:31.653091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:31.655341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-462df763-b9b1-4920-8c02-b4835d9c4183 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.152930 Jun 23 11:09:31.656776 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 457/924] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:31 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:32.674649 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:32.675257 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:32.682683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:32.683123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:32.683920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:32.684641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:32.836717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:32.848471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:32.850192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:32.851681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7d894b50-7248-46db-88ce-919901262b24 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.181072 Jun 23 11:09:32.852555 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 468/925] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:32 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:33.633357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:33.633881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:33.636415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:33.642961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:33.643685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:33.644648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:33.645239 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:33.661920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] HTTP exception thrown: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Request method failure captured: Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba HTTP/1.1 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEg2ZrjJvdQQCsoWQKA0NrSTZ0XXIRUelnfDYETx8ssH1dzLuWqsg66LvXdwVpZ_JXY7dw2oyX5ncZKgeMfQhlPFjG3P6nsDZ-7Rl2MdVIlM8kYzQnReHHgafXPZ9HPCu-B4Z-aQ3YqluwtpCR2VgwEWRkHqHXAI6CX_y0y3zObTRx8 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:33.663904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ac9f9313c3ac4dde97e75ac6fa8fae11", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 303e8aae1bd04228bedb145dec891a3e Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.665474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': 'a1a14dfc-929a-475c-ac07-48e81f7d53ba'} Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:33.666398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.668400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.670507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Returning 404 to user: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:33.671496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6ba4966b-9046-4a69-8631-41fac3c72af7 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 404 len: 111 microversion: 2.1 time: 0.042064 Jun 23 11:09:33.672312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 458/926] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:33 2022] DELETE /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:33.680273 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:33.680897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: a1a14dfc-929a-475c-ac07-48e81f7d53ba] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:33.690468 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:33.691007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:33.691888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:33.692406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:33.711093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] HTTP exception thrown: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Request method failure captured: Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba HTTP/1.1 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEg2ZrjJvdQQCsoWQKA0NrSTZ0XXIRUelnfDYETx8ssH1dzLuWqsg66LvXdwVpZ_JXY7dw2oyX5ncZKgeMfQhlPFjG3P6nsDZ-7Rl2MdVIlM8kYzQnReHHgafXPZ9HPCu-B4Z-aQ3YqluwtpCR2VgwEWRkHqHXAI6CX_y0y3zObTRx8 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:33.713673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ac9f9313c3ac4dde97e75ac6fa8fae11", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 303e8aae1bd04228bedb145dec891a3e Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.715277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': 'a1a14dfc-929a-475c-ac07-48e81f7d53ba'} Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:33.716239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. Jun 23 11:09:33.717711 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:33.719019 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Returning 404 to user: Instance a1a14dfc-929a-475c-ac07-48e81f7d53ba could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:33.719442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8612c841-9513-4ec0-b3b6-cd01c4910e23 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba" status: 404 len: 111 microversion: 2.1 time: 0.040945 Jun 23 11:09:33.720322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 469/927] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:33 2022] GET /compute/v2.1/servers/a1a14dfc-929a-475c-ac07-48e81f7d53ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:33.871206 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:33.871698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:33.878067 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:33.878720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:33.879484 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:33.880094 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:34.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:34.203547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:34.205309 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:34.206514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d8f9522e-3848-4c62-96fd-9b036584406c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.339992 Jun 23 11:09:34.207524 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 459/928] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:33 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:35.225634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:35.226361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:35.233287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:35.233729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:35.234492 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:35.234918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:35.368319 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:35.377201 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:35.378749 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:35.379938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-93130bdf-84b9-46a8-86eb-28404c38b5c1 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.158175 Jun 23 11:09:35.380481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 470/929] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:35 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:36.398366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:36.398977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:36.405631 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:36.406084 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:36.406851 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:36.407290 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:36.544584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:36.552401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:36.553832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:36.554989 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c22c8f63-b580-4298-ae3c-dfa4725e9c7e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1739 microversion: 2.20 time: 0.160626 Jun 23 11:09:36.555518 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 460/930] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:36 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:37.574489 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:37.575099 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:37.581974 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:37.582440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:37.583198 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:37.583799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:37.703146 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:37.703785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:37.710541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:37.710993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:37.711809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:37.712250 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:37.796072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lazy-loading 'services' on Instance uuid 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:09:37.804316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:37.815875 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:37.817509 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:37.818668 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-91f913c9-7ec9-4de1-b835-6e78e19d79fa tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1721 microversion: 2.20 time: 0.248441 Jun 23 11:09:37.819225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 471/931] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:37 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:37.873613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8299c77d-a208-4599-b9d3-66faaf5f575b tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments/463dddc1-471a-4710-97dd-acede617c2c7" status: 202 len: 0 microversion: 2.1 time: 0.174258 Jun 23 11:09:37.874327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 461/932] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:09:37 2022] DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments/463dddc1-471a-4710-97dd-acede617c2c7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:09:37.882706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:37.883630 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:37.890564 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:37.891021 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:37.891918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:37.892533 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:37.933267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-224f46b5-5e3c-465a-ab56-20de3eb356ae tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054431 Jun 23 11:09:37.933824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 472/933] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:37 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:38.015085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:38.015685 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:38.021869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.022314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.023072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.023506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.037156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] HTTP exception thrown: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Request method failure captured: Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d HTTP/1.1 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEg2ZrjJvdQQCsoWQKA0NrSTZ0XXIRUelnfDYETx8ssH1dzLuWqsg66LvXdwVpZ_JXY7dw2oyX5ncZKgeMfQhlPFjG3P6nsDZ-7Rl2MdVIlM8kYzQnReHHgafXPZ9HPCu-B4Z-aQ3YqluwtpCR2VgwEWRkHqHXAI6CX_y0y3zObTRx8 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:38.038787 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ac9f9313c3ac4dde97e75ac6fa8fae11", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 303e8aae1bd04228bedb145dec891a3e Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.040411 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d'} Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:38.041733 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.043225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.045083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Returning 404 to user: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:38.045083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1accd548-00bc-4ca9-a2c6-8aa9ef03d788 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 404 len: 111 microversion: 2.1 time: 0.029489 Jun 23 11:09:38.045083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 462/934] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:38 2022] DELETE /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:38.049089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:38.049724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] [instance: 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:38.055683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.056137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.057482 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.057913 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.070976 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] HTTP exception thrown: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Request method failure captured: Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d HTTP/1.1 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEg2ZrjJvdQQCsoWQKA0NrSTZ0XXIRUelnfDYETx8ssH1dzLuWqsg66LvXdwVpZ_JXY7dw2oyX5ncZKgeMfQhlPFjG3P6nsDZ-7Rl2MdVIlM8kYzQnReHHgafXPZ9HPCu-B4Z-aQ3YqluwtpCR2VgwEWRkHqHXAI6CX_y0y3zObTRx8 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:38.072544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ac9f9313c3ac4dde97e75ac6fa8fae11", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ac9f9313c3ac4dde97e75ac6fa8fae11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: ac9f9313c3ac4dde97e75ac6fa8fae11 Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2648044 Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 303e8aae1bd04228bedb145dec891a3e Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeTestJSON-2648044-project Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.074139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d'} Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:38.075046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. Jun 23 11:09:38.076600 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:38.077892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] Returning 404 to user: Instance 9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:38.077892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21924d0f-bd21-437f-bfd9-35af9865c415 tempest-AttachVolumeTestJSON-2648044 tempest-AttachVolumeTestJSON-2648044-project] 10.222.0.65 "GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d" status: 404 len: 111 microversion: 2.1 time: 0.028651 Jun 23 11:09:38.077892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 473/935] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:38 2022] GET /compute/v2.1/servers/9ff2d2b9-fa0c-4aba-8650-c5eb43a3067d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:38.838506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:38.839129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:38.845794 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.846307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.847243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.847608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.866702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:38.945525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:38.946445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:38.953640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.954083 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.955275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:38.955593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:38.987628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8526d392-9a7d-45fe-833c-b04f37b67362 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Jun 23 11:09:38.988237 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 474/936] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:38 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:09:39.090002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:39.099807 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:39.101427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:39.102916 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7454fd10-f10f-4e4c-84a1-809ff6336702 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1721 microversion: 2.20 time: 0.268787 Jun 23 11:09:39.104187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 463/937] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:38 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:39.998409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:39.999476 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:40.006326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:40.006549 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:40.007519 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:40.008141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:40.042494 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-60825c25-9d79-4995-8f9c-cf366b027315 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047955 Jun 23 11:09:40.043856 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 475/938] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:39 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:09:40.122194 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:40.123760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:40.130938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:40.131519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:40.132417 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:40.132941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:40.352063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:40.366063 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:40.368433 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:40.370534 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a8036cc2-009c-4f89-a169-d14450be01ce tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1721 microversion: 2.20 time: 0.252518 Jun 23 11:09:40.380642 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 464/939] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:40 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:41.053930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:41.054850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:41.061312 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.061757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.062517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.063148 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.102238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1f00f40b-b231-43c3-ba04-feac9db80cb0 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052251 Jun 23 11:09:41.103132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 476/940] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:09:41 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:09:41.176920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:41.178264 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:41.187785 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.188233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.189739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.190318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.220504 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:09:41.324249 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9f92b1c7-b7b3-422b-a3c7-2db81464ed81 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 204 len: 0 microversion: 2.1 time: 0.151320 Jun 23 11:09:41.324838 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 465/941] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:41 2022] DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:09:41.334030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:41.338348 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:41.346375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.346820 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.347589 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.352737 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.401079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:41.401875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:41.412278 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.413062 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.413991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.414444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.540908 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:41.549053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ec782c10-4643-42f5-b929-98607aa44a5a tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1680 microversion: 2.1 time: 0.219625 Jun 23 11:09:41.549814 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 477/942] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:41 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:41.609008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:41.617085 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:41.618588 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:41.620439 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a1668d85-6beb-4b12-a4e1-8baab87f328a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1664 microversion: 2.20 time: 0.226934 Jun 23 11:09:41.621001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 466/943] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:41 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1664 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:41.638615 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efe80bc6-c3e1-47b5-98cb-70efed617bca"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:41.640013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:41.645895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.646339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.647103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:41.647532 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:41.720670 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:41.924343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2b106ee-597c-45fd-9217-74f3220781fd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290209 Jun 23 11:09:41.925031 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 478/944] 10.222.0.65 () {62 vars in 1363 bytes} [Thu Jun 23 11:09:41 2022] POST /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:09:42.042656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:42.043151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:42.049639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:42.050091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:42.050870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:42.051306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:42.566446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:42.567062 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:42.573590 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:42.574037 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:42.574806 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:42.575242 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:42.757691 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:42.766026 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d52a5768-a7e2-4ece-a402-2657fddd058e tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1680 microversion: 2.1 time: 0.203544 Jun 23 11:09:42.766578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 479/945] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:42 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:43.515909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0fe0b0fb-e652-4b13-8dc2-e9d015d78653 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-volume_attachments/efe80bc6-c3e1-47b5-98cb-70efed617bca" status: 202 len: 0 microversion: 2.20 time: 1.476825 Jun 23 11:09:43.517478 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 467/946] 10.222.0.65 () {60 vars in 1456 bytes} [Thu Jun 23 11:09:42 2022] DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-volume_attachments/efe80bc6-c3e1-47b5-98cb-70efed617bca => generated 0 bytes in 1479 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:09:43.547211 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-d832fed7-7cd1-48e2-8a47-083f3082a7c0 req-2d585445-fdb2-4bbe-a468-c70821794cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "name": "network-vif-unplugged", "status": "completed", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:43.560024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d832fed7-7cd1-48e2-8a47-083f3082a7c0 req-2d585445-fdb2-4bbe-a468-c70821794cdd service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.561512 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-d832fed7-7cd1-48e2-8a47-083f3082a7c0 req-2d585445-fdb2-4bbe-a468-c70821794cdd service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.589044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.compute.server_external_events [req-d832fed7-7cd1-48e2-8a47-083f3082a7c0 req-2d585445-fdb2-4bbe-a468-c70821794cdd service nova] Unable to find a host for instance 248be1ac-b2c3-4081-adba-30258b95aa91. Dropping event network-vif-unplugged {{(pid=117877) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 11:09:43.590231 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-d832fed7-7cd1-48e2-8a47-083f3082a7c0 req-2d585445-fdb2-4bbe-a468-c70821794cdd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050308 Jun 23 11:09:43.590823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 480/947] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 11:09:43.595236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:43.596168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:43.603067 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.604181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.605079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.605975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.700120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3f98d7d7-d589-4520-97e2-52c95facc631 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "POST /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/action" status: 202 len: 0 microversion: 2.20 time: 0.117791 Jun 23 11:09:43.700731 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 468/948] 10.222.0.65 () {62 vars in 1318 bytes} [Thu Jun 23 11:09:43 2022] POST /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:09:43.708739 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:43.709343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:43.715882 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.716584 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.716946 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.717374 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.784477 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:43.785270 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:43.791929 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.793018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.794378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:43.795212 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:43.862799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:43.872457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:43.873924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:43.875135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d3f5e6c9-4ff3-48b3-9721-03a3df10d8bc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1672 microversion: 2.20 time: 0.170264 Jun 23 11:09:43.875735 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 481/949] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:43 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:44.009272 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:44.017991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0f33750d-3fa1-42dd-9444-7376efd9f1d9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1680 microversion: 2.1 time: 0.239384 Jun 23 11:09:44.018665 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 469/950] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:43 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:09:44.894446 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:44.895190 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:44.902506 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:44.902969 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:44.903867 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:44.904365 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:45.037802 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:45.039266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:45.046327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:45.046776 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:45.047553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:45.048018 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:45.137420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:45.145907 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:45.147455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:45.148643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-29648407-5718-44f9-847c-8923558d51c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1674 microversion: 2.20 time: 0.258184 Jun 23 11:09:45.149385 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 482/951] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:44 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1674 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:45.199456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:45.207952 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f5662055-5666-41a0-847b-0a716c9b2d29 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1680 microversion: 2.1 time: 0.175453 Jun 23 11:09:45.217698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 470/952] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:45 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:09:46.167439 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:46.168073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:46.174683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:46.175124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:46.175915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:46.176445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:46.226732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:46.227731 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:46.237888 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:46.239354 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:46.240979 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:46.241592 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:46.336899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:46.346701 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ccfeca61-e1d8-401a-9898-5b6f5ab70213 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1613 microversion: 2.1 time: 0.126318 Jun 23 11:09:46.347275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 471/953] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:46 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1613 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:46.508957 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:46.519267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:46.521629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:46.523463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4894158a-cb54-4e9c-ad01-f4f84f9e322c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.359989 Jun 23 11:09:46.524895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 483/954] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:46 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:46.794967 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-24272558-1b9a-4281-b94c-c52605dc66c6 req-52064204-12ff-4e8a-ac3a-06803ea14cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9081938b-1ccb-467a-bbbc-c2b2c1ddf599", "name": "network-vif-deleted", "tag": "cf1e62a0-e03e-459d-a279-4ffbdae64ff6"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:46.803641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-24272558-1b9a-4281-b94c-c52605dc66c6 req-52064204-12ff-4e8a-ac3a-06803ea14cad service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:46.804461 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-24272558-1b9a-4281-b94c-c52605dc66c6 req-52064204-12ff-4e8a-ac3a-06803ea14cad service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:46.817892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-24272558-1b9a-4281-b94c-c52605dc66c6 req-52064204-12ff-4e8a-ac3a-06803ea14cad service nova] Creating event network-vif-deleted:cf1e62a0-e03e-459d-a279-4ffbdae64ff6 for instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 on hv-cinder-84330 Jun 23 11:09:46.834343 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-24272558-1b9a-4281-b94c-c52605dc66c6 req-52064204-12ff-4e8a-ac3a-06803ea14cad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043023 Jun 23 11:09:46.835186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 472/955] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:09:47.365752 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:47.367406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:47.374343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:47.375014 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:47.375971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:47.376768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:47.421464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:47.422046 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:47.423184 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lazy-loading 'fault' on Instance uuid 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:09:47.479396 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7d511abd8544878e7d0097a1ab0319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578cf1b29d474080a716e77fe2e84e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:47.489249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-215323d6-9c95-49d3-8ee9-9d7b49faeac2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 200 len: 1331 microversion: 2.1 time: 0.128383 Jun 23 11:09:47.502013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 484/956] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:47 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:09:47.553697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:47.555914 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:47.568495 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:47.569379 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:47.570514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:47.571165 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:47.880306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:47.891381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:47.896334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:47.905864 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c7b184cb-3173-4741-b980-c19bf1954351 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.366619 Jun 23 11:09:47.908569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 473/957] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:47 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:09:48.512680 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:48.513681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:48.528425 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:48.531015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:48.533561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:48.534026 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:48.565921 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 HTTP/1.1 Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:48.569725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:48.571669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '9081938b-1ccb-467a-bbbc-c2b2c1ddf599'} Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:48.573272 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:48.575787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:48.579631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:48.581050 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c9ee045b-1ccb-4aa5-8ce5-809454dc77f9 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 404 len: 111 microversion: 2.1 time: 0.075775 Jun 23 11:09:48.582153 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 485/958] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:48 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:09:48.595518 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4d4ed9fa-8e5a-47c0-8207-a7d65e529552 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '.version_select at 0x7f089c718ee0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:48.622225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4d4ed9fa-8e5a-47c0-8207-a7d65e529552 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-138776892" status: 202 len: 0 microversion: 2.1 time: 0.034121 Jun 23 11:09:48.623620 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 474/959] 10.222.0.65 () {58 vars in 1217 bytes} [Thu Jun 23 11:09:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-138776892 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:09:48.925035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:48.925803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:48.934178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:48.934882 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:48.937229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:48.949786 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:49.225691 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:49.235323 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:49.241655 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:49.243551 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cc9fa27a-efee-4cb7-9bca-0a1dc753c214 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.322884 Jun 23 11:09:49.256739 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 486/960] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:48 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:50.275795 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:50.277626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:50.289855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:50.292490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:50.296612 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:50.297255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:50.653480 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:50.662096 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:50.667450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:50.668833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bbcbb1c6-b156-4e80-a83e-5269f9f3aedd tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.397111 Jun 23 11:09:50.672801 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 475/961] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:50 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:51.116967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:51.117610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:51.129496 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:51.130005 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:51.144985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:51.146710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:51.182911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 HTTP/1.1 Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:51.189251 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.191412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '9081938b-1ccb-467a-bbbc-c2b2c1ddf599'} Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:51.192635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.194602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.197746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:51.197746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-877188bc-438b-4b79-96ed-ce8515ad06cb tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 404 len: 111 microversion: 2.1 time: 0.078508 Jun 23 11:09:51.200555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:51.201223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 9081938b-1ccb-467a-bbbc-c2b2c1ddf599] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:51.209540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 487/962] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:51 2022] DELETE /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:51.216048 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:51.216557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:51.217358 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:51.217919 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:51.241616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 HTTP/1.1 Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:51.243427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.244953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '9081938b-1ccb-467a-bbbc-c2b2c1ddf599'} Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:51.245734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. Jun 23 11:09:51.247676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:51.250132 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 9081938b-1ccb-467a-bbbc-c2b2c1ddf599 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:51.250519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6e399938-213f-4bda-9ded-fef0f096e230 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599" status: 404 len: 111 microversion: 2.1 time: 0.049886 Jun 23 11:09:51.253056 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 476/963] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:51 2022] GET /compute/v2.1/servers/9081938b-1ccb-467a-bbbc-c2b2c1ddf599 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:51.699915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:51.701028 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:51.708302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:51.708962 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:51.709731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:51.710895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.145057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:52.153328 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:52.159773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:52.162336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0dd6a1e2-6762-44be-9fa4-6af7ff46d4d2 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.473596 Jun 23 11:09:52.165174 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 488/964] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:51 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:52.543820 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:52.545415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:52.554203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.555001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.556211 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.557020 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.577403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d HTTP/1.1 Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:52.579889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.581582 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '3eed5440-b2dd-4413-84ff-fe74e9bdbf0d'} Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:52.582977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.585456 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.590305 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:52.591907 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-dfe6ff4a-8a29-4fd6-ac7a-1af4aee7dc0d tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 404 len: 111 microversion: 2.1 time: 0.053466 Jun 23 11:09:52.605478 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:52.607124 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:52.612546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 477/965] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:52 2022] DELETE /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:52.618772 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.621313 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.622669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.624096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.649025 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d HTTP/1.1 Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:52.652082 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.653641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '3eed5440-b2dd-4413-84ff-fe74e9bdbf0d'} Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:52.654390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. Jun 23 11:09:52.656221 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.658262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 3eed5440-b2dd-4413-84ff-fe74e9bdbf0d could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:52.658262 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1420313d-a1e8-4c44-8754-a61ae5b25663 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d" status: 404 len: 111 microversion: 2.1 time: 0.059239 Jun 23 11:09:52.662041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 489/966] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:52 2022] GET /compute/v2.1/servers/3eed5440-b2dd-4413-84ff-fe74e9bdbf0d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:52.672579 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:52.673482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:52.691467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.693312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.695377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.699337 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.703873 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:52.717961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 HTTP/1.1 Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:52.719947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.721547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5'} Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:52.722415 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.723747 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.726703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:52.727900 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4b7d629f-14bd-4f83-9a51-cd0737e617c3 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 404 len: 111 microversion: 2.1 time: 0.063670 Jun 23 11:09:52.729610 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 478/967] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:52 2022] DELETE /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:52.737340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:52.737953 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:52.752149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.752595 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.754002 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:52.754606 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:52.778484 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 HTTP/1.1 Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:52.790403 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.792673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5'} Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:52.793566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. Jun 23 11:09:52.795011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:52.797431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:52.798442 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7183e31a-92df-430e-9081-634d74fdffd2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5" status: 404 len: 111 microversion: 2.1 time: 0.064988 Jun 23 11:09:52.799778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 490/968] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:52 2022] GET /compute/v2.1/servers/6f3f0a14-7e6d-4645-b920-a8dc0ad5a9b5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:53.185894 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:53.186798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:53.195021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:53.196114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:53.198083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:53.198738 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:53.462690 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:53.477512 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:53.480959 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:53.486544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-0637a5ce-a19a-41a7-a5c4-68c4b090d988 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.304862 Jun 23 11:09:53.487388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 479/969] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:53 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:54.194314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:54.195510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:54.218247 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:54.218697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:54.219510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:54.219936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:54.253990 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 HTTP/1.1 Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:09:54.255923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.257336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '2946bfb4-cd02-4237-8291-ad974a96ded6'} Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:54.258115 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.259394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.261304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:54.261304 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-21a8a81b-706c-4590-9e74-06d8be7f6486 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 404 len: 111 microversion: 2.1 time: 0.067810 Jun 23 11:09:54.264504 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 491/970] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:09:54 2022] DELETE /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:09:54.268187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:54.268888 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] [instance: 2946bfb4-cd02-4237-8291-ad974a96ded6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:54.284870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:54.285329 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:54.286122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:54.286564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:54.331041 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] HTTP exception thrown: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Request method failure captured: Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 HTTP/1.1 Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEgwyM0SR1TsyhAPm0vZkV2N8cqCBr091cRDnzpishlI9Bf1zCgx9kIwjFePBF2cybVSIjGkgAiIhG6mAiNd2IclIfAksQltyOfEpus2RnEgSKGCe9BxJxxRfiYEPxgl0uqslsukI6LtArAPYyazdE5nKueYHaZPxxDyEZ4pgNLoYR4 Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:09:54.333047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_578cf1b29d474080a716e77fe2e84e5b", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/578cf1b29d474080a716e77fe2e84e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 578cf1b29d474080a716e77fe2e84e5b Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1653899856 Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: df7d511abd8544878e7d0097a1ab0319 Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeNegativeTest-1653899856-project Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.334715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '2946bfb4-cd02-4237-8291-ad974a96ded6'} Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:09:54.335702 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. Jun 23 11:09:54.337275 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:09:54.342101 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] Returning 404 to user: Instance 2946bfb4-cd02-4237-8291-ad974a96ded6 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:09:54.343434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-512ac5cf-c761-4d00-b3fd-d40342a011b2 tempest-AttachVolumeNegativeTest-1653899856 tempest-AttachVolumeNegativeTest-1653899856-project] 10.222.0.65 "GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6" status: 404 len: 111 microversion: 2.1 time: 0.079646 Jun 23 11:09:54.349187 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 480/971] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:09:54 2022] GET /compute/v2.1/servers/2946bfb4-cd02-4237-8291-ad974a96ded6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:09:54.514886 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:54.515800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:54.523646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:54.525430 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:54.526829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:54.528824 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:54.883743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:54.900089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:54.906032 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:54.910683 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a6ff8d8c-4c6d-45c1-b7b4-f4f258b7560f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.398831 Jun 23 11:09:54.913586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 492/972] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:54 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:55.931387 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:55.932168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:55.940032 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:55.940619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:55.941506 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:55.942170 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:56.130931 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:56.139352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:56.143483 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:56.148025 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2c70e716-58e1-4d8b-991c-2c2b75504bb0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.220406 Jun 23 11:09:56.148725 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 481/973] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:55 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:57.166549 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:57.167325 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:57.173653 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:57.174095 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:57.175055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:57.175698 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:57.312729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:57.325544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:57.327537 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:57.328982 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3235b0be-dc86-4522-b81e-30304f5fc701 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.166260 Jun 23 11:09:57.330273 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 493/974] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:57 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:58.346481 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:58.347779 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:58.354950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:58.364152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:58.365252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:58.365854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:58.628114 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:58.642156 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:58.643833 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:58.645003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4188ecfc-99dc-4f27-af6b-f7a97376afb8 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.302488 Jun 23 11:09:58.657414 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 482/975] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:58 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:09:59.662331 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:09:59.662945 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:09:59.669476 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:09:59.671723 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:59.672418 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:59.675895 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:59.676447 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:59.795237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-19866ccb-6835-4699-914a-1c5db6a51da8 req-ebe41e53-8567-4225-83b1-5f2865205937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "name": "network-vif-plugged", "status": "completed", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:09:59.819474 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-19866ccb-6835-4699-914a-1c5db6a51da8 req-ebe41e53-8567-4225-83b1-5f2865205937 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:09:59.820298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-19866ccb-6835-4699-914a-1c5db6a51da8 req-ebe41e53-8567-4225-83b1-5f2865205937 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:09:59.849189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-19866ccb-6835-4699-914a-1c5db6a51da8 req-ebe41e53-8567-4225-83b1-5f2865205937 service nova] Creating event network-vif-plugged:51cdb0e1-56be-4180-8c9e-d3a829c5bb64 for instance 248be1ac-b2c3-4081-adba-30258b95aa91 on hv-cinder-84330 Jun 23 11:09:59.850702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:59.863281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:59.864352 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-19866ccb-6835-4699-914a-1c5db6a51da8 req-ebe41e53-8567-4225-83b1-5f2865205937 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083518 Jun 23 11:09:59.866213 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:09:59.867715 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 483/976] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:09:59.868823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ae3eee1b-2838-4d0b-89a3-98bbfd265ac0 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.210335 Jun 23 11:09:59.870055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 494/977] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:09:59 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:00.889423 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:00.890196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:00.897054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:00.897606 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:00.898429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:00.899033 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:01.046287 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:01.054186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:01.055743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:01.057441 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5a00e134-fa45-4c2e-b1d9-e1214e74bd40 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1730 microversion: 2.20 time: 0.172879 Jun 23 11:10:01.058003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 484/978] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:00 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:02.077084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:02.077763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:02.106345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:02.107110 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:02.108123 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:02.108780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:02.272411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:02.280415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:02.281968 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:02.283205 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fca11b0f-a68b-4974-9005-026043c7e73e tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1717 microversion: 2.20 time: 0.211000 Jun 23 11:10:02.283783 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 495/979] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:02 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:14.217077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1279088491", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-789488599", "security_groups": [{"name": "tempest-secgroup-smoke-1647556123"}], "block_device_mapping_v2": [{"uuid": "fbfd0ca7-4789-438a-a989-0cb2296ae1e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c33ca82f-6e79-4afd-a43f-c1b68283a4eb"}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:14.226364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.227019 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=29 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.334521 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] validate_networks() for [('c33ca82f-6e79-4afd-a43f-c1b68283a4eb', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:10:14.727532 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:10:14.728043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:10:14.728681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:10:14.729669 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:10:14.730164 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:10:14.744749 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:14.758380 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:14.759698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:14.760376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:14.777920 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:10:14.781853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Getting quotas for user 8f8da2142b9e4751b436cfd4920587a0 and project 1fccc592269f433b99c2d13dad5e8e39. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:10:14.839079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:10:14.841273 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbfd0ca7-4789-438a-a989-0cb2296ae1e7',volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:10:14.969849 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a0113f9a-c9a1-4a52-9eb2-c97f7635f8c6 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756936 Jun 23 11:10:14.970479 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 485/980] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:10:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:10:14.981343 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f64be478-8c23-4dc8-b65d-600a261bf798 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:14.982057 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f64be478-8c23-4dc8-b65d-600a261bf798 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:14.985753 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.986464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:15.045091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f64be478-8c23-4dc8-b65d-600a261bf798 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:15.051764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f64be478-8c23-4dc8-b65d-600a261bf798 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1094 microversion: 2.1 time: 0.075160 Jun 23 11:10:15.052327 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 496/981] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:14 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:16.069242 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:16.069956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:16.084977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:16.097208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:16.098220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:16.098790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:16.187143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:16.201279 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-432b7a30-155c-40ed-b503-3786c4838718 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1210 microversion: 2.1 time: 0.135935 Jun 23 11:10:16.202109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 486/982] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:16 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1210 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:17.221585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:17.222959 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:17.235690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:17.236514 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:17.237327 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:17.237800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:17.497993 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:17.507470 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5bc55d20-e7c3-41cf-8f43-0a29c8e48712 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.291466 Jun 23 11:10:17.519437 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 497/983] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:17 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:17.634977 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-719fe650-006b-4f54-97a2-d05d3345efea req-bf861756-41b8-462a-adfe-ceb73d7673fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a71f3-1252-4ffa-bf80-909aac0f8abe", "tag": "242b880a-a6ce-40f9-922e-b675d23563b9"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:17.646136 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-719fe650-006b-4f54-97a2-d05d3345efea req-bf861756-41b8-462a-adfe-ceb73d7673fd service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:17.646950 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-719fe650-006b-4f54-97a2-d05d3345efea req-bf861756-41b8-462a-adfe-ceb73d7673fd service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:17.661410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-719fe650-006b-4f54-97a2-d05d3345efea req-bf861756-41b8-462a-adfe-ceb73d7673fd service nova] Creating event network-changed:242b880a-a6ce-40f9-922e-b675d23563b9 for instance d93a71f3-1252-4ffa-bf80-909aac0f8abe on hv-cinder-84330 Jun 23 11:10:17.678884 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-719fe650-006b-4f54-97a2-d05d3345efea req-bf861756-41b8-462a-adfe-ceb73d7673fd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048222 Jun 23 11:10:17.680031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 487/984] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:10:18.524930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:18.525316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:18.532534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:18.533007 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:18.533765 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:18.534197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:18.772210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:18.781142 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5ecb654f-1536-44af-890d-6ce19cf023aa tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.260193 Jun 23 11:10:18.781837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 498/985] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:18 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:19.799065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:19.799891 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:19.807225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:19.807943 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:19.808816 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:19.809315 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:19.947750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:19.956150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-590f4c96-a688-4da1-a4d6-39f8cb55b424 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.161218 Jun 23 11:10:19.956700 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 488/986] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:19 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:20.974602 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:20.975414 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:20.981473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:20.981944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:20.982915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:20.983344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:21.121218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:21.131599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-49266dce-d937-48c7-8c3d-63176f807d17 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.161385 Jun 23 11:10:21.132285 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 499/987] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:20 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:22.149186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:22.149808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:22.156349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:22.156803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:22.157601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:22.158040 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:22.299032 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:22.307055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cfd308b1-8566-4265-ae03-fde9322ca154 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.161736 Jun 23 11:10:22.307613 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 489/988] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:22 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:23.324541 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:23.325141 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:23.333106 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:23.333551 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:23.334337 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:23.334778 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:23.469233 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:23.476574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fa32522-aac6-4b7e-ae1f-be867893f728 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.155906 Jun 23 11:10:23.477127 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 500/989] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:23 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:24.493729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:24.494383 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:24.500946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:24.501407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:24.502174 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:24.502610 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:24.646027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:24.655763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-94138c1b-940a-49af-a9c5-ee41cc517ac3 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.165849 Jun 23 11:10:24.656348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 490/990] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:24 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:25.673406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:25.674045 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:25.675898 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:25.681721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:25.682161 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:25.682910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:25.683336 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:25.818180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:25.825840 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f5894380-2cea-445c-afc5-62706f63675c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.157012 Jun 23 11:10:25.826372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 501/991] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:25 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:26.841942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:26.842557 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:26.844556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:26.845209 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=6 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:26.850957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:26.851413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:26.852214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:26.852686 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:26.980980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:26.989010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fe758d4c-e331-4752-a048-d3e2956154ee tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.151024 Jun 23 11:10:26.989502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 491/992] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:26 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:28.006112 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:28.006721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:28.013102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:28.014105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:28.014802 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:28.015230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:28.142936 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:28.150257 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9f929102-1ee7-46d6-9c17-688f361eb715 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.148020 Jun 23 11:10:28.150819 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 502/993] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:28 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:29.166904 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:29.167544 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:29.174150 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:29.174599 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:29.175367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:29.175837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:29.302297 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:29.309681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-43cd0df9-1940-493f-ba34-8a1de4ccef29 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.146659 Jun 23 11:10:29.310230 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 492/994] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:29 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:30.326454 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:30.327068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:30.333587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:30.334036 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:30.334799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:30.335234 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:30.464182 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:30.471957 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2d00a19-ef86-41e2-bd4e-203fea481f1d tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.149972 Jun 23 11:10:30.472515 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 503/995] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:30 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:31.487999 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:31.488609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:31.495008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:31.495460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:31.496263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:31.496712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:31.628203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:31.635543 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7a1136ec-1ffb-466c-8da6-9aa88233edd4 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.151347 Jun 23 11:10:31.636124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 493/996] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:31 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:32.659826 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-99ed353d-cb95-41f9-8376-6a18f7c30bac req-b2a6fb9a-77a9-4fac-a4d1-3ff4e14fa34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a71f3-1252-4ffa-bf80-909aac0f8abe", "name": "network-vif-plugged", "status": "completed", "tag": "242b880a-a6ce-40f9-922e-b675d23563b9"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:32.670269 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-99ed353d-cb95-41f9-8376-6a18f7c30bac req-b2a6fb9a-77a9-4fac-a4d1-3ff4e14fa34b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:32.671058 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-99ed353d-cb95-41f9-8376-6a18f7c30bac req-b2a6fb9a-77a9-4fac-a4d1-3ff4e14fa34b service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:32.688400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-99ed353d-cb95-41f9-8376-6a18f7c30bac req-b2a6fb9a-77a9-4fac-a4d1-3ff4e14fa34b service nova] Creating event network-vif-plugged:242b880a-a6ce-40f9-922e-b675d23563b9 for instance d93a71f3-1252-4ffa-bf80-909aac0f8abe on hv-cinder-84330 Jun 23 11:10:32.694094 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-99ed353d-cb95-41f9-8376-6a18f7c30bac req-b2a6fb9a-77a9-4fac-a4d1-3ff4e14fa34b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038239 Jun 23 11:10:32.695105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 504/997] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:10:32.705784 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:32.706430 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:32.713117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:32.713570 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:32.714341 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:32.714777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:32.843033 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:32.850390 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8f65b48c-171f-4a4d-a208-c68f35757982 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.148746 Jun 23 11:10:32.850947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 494/998] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:32 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:33.868590 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:33.869333 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:33.876914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:33.877356 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:33.878311 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:33.878743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:34.015949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:34.023787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cc8f60da-7152-4117-84be-eef3cb31ef32 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1266 microversion: 2.1 time: 0.159511 Jun 23 11:10:34.024344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 505/999] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:33 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:35.041263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:35.041870 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:35.048434 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:35.048881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:35.049673 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:35.050106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:35.186288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:35.193641 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7c246b6e-f181-4c9b-a3be-2d6022db9265 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1454 microversion: 2.1 time: 0.156418 Jun 23 11:10:35.194195 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 495/1000] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:35 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:35.209445 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:35.210080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:35.216460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:35.216908 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:35.217662 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:35.218091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:35.348867 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:35.356236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-423a6085-5bfb-46a2-bfa2-609b574a65e7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1454 microversion: 2.1 time: 0.150675 Jun 23 11:10:35.356788 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 506/1001] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:10:35 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:37.122650 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:10:37.123287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Thu Jun 23 11:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:10:37.348392 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-c7940f24-f726-4ff7-91b1-deba5279f826 req-c2e53672-716a-4309-b63d-6b9ee8487a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a71f3-1252-4ffa-bf80-909aac0f8abe", "tag": "242b880a-a6ce-40f9-922e-b675d23563b9"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:37.361978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-c7940f24-f726-4ff7-91b1-deba5279f826 req-c2e53672-716a-4309-b63d-6b9ee8487a1c service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:37.362645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-c7940f24-f726-4ff7-91b1-deba5279f826 req-c2e53672-716a-4309-b63d-6b9ee8487a1c service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:37.377444 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-c7940f24-f726-4ff7-91b1-deba5279f826 req-c2e53672-716a-4309-b63d-6b9ee8487a1c service nova] Creating event network-changed:242b880a-a6ce-40f9-922e-b675d23563b9 for instance d93a71f3-1252-4ffa-bf80-909aac0f8abe on hv-cinder-84330 Jun 23 11:10:37.384086 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-c7940f24-f726-4ff7-91b1-deba5279f826 req-c2e53672-716a-4309-b63d-6b9ee8487a1c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038712 Jun 23 11:10:37.391601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 496/1002] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:10:50.300259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:50.301739 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:50.304294 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=24 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:50.305200 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=56 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:50.311087 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:50.311997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:50.312786 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:50.313216 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:50.349093 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a1a5373-7778-408f-9b93-f0f87d0568dc tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052906 Jun 23 11:10:50.349646 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 507/1003] 10.222.0.65 () {60 vars in 1342 bytes} [Thu Jun 23 11:10:50 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:10:50.426561 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:50.427168 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:50.429779 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:50.430422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=60 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:50.438152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:50.438821 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:50.440363 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:50.441068 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:50.474234 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:10:50.576841 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f78f0d06-8a86-4b99-943c-055f39e3c665 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 204 len: 0 microversion: 2.20 time: 0.154010 Jun 23 11:10:50.578338 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 497/1004] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Jun 23 11:10:50 2022] DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:10:50.590574 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:50.591180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:50.597743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:50.598188 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:50.602699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:50.603458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:50.784249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:50.792838 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:50.794402 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:50.795594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c30ea4e-1467-44c3-8a96-fe394341742c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.209144 Jun 23 11:10:50.796240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 508/1005] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:50 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:51.822492 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:51.823530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:51.830204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:51.830782 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:51.831724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:51.832381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:52.074046 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:52.119048 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:52.122917 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:52.125010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c0a6967f-711f-4ad1-b4f5-38e9705f5625 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1723 microversion: 2.20 time: 0.314323 Jun 23 11:10:52.126117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 498/1006] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:51 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:53.145473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:53.146165 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:53.153421 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:53.154202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:53.155152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:53.155788 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:53.259713 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:53.272410 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:53.293339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:53.297236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-08529e54-9f08-4cc6-b58d-d7365817d323 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1655 microversion: 2.20 time: 0.156005 Jun 23 11:10:53.304900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 509/1007] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:53 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:53.345104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-3b2a394d-16b5-446b-9e76-c2c4cdf30529 req-a450f0c4-3923-4a48-80d5-6b55a8fc759d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248be1ac-b2c3-4081-adba-30258b95aa91", "name": "network-vif-deleted", "tag": "51cdb0e1-56be-4180-8c9e-d3a829c5bb64"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:10:53.365312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-3b2a394d-16b5-446b-9e76-c2c4cdf30529 req-a450f0c4-3923-4a48-80d5-6b55a8fc759d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:53.371525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-3b2a394d-16b5-446b-9e76-c2c4cdf30529 req-a450f0c4-3923-4a48-80d5-6b55a8fc759d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:53.393064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-3b2a394d-16b5-446b-9e76-c2c4cdf30529 req-a450f0c4-3923-4a48-80d5-6b55a8fc759d service nova] Creating event network-vif-deleted:51cdb0e1-56be-4180-8c9e-d3a829c5bb64 for instance 248be1ac-b2c3-4081-adba-30258b95aa91 on hv-cinder-84330 Jun 23 11:10:53.401017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-3b2a394d-16b5-446b-9e76-c2c4cdf30529 req-a450f0c4-3923-4a48-80d5-6b55a8fc759d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063642 Jun 23 11:10:53.402450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 499/1008] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:10:54.322315 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:54.325918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:54.363899 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:54.364559 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:54.366308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:54.368130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:54.431408 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:54.432183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:54.432858 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lazy-loading 'fault' on Instance uuid 248be1ac-b2c3-4081-adba-30258b95aa91 {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:10:54.548543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:54.557637 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:54.560363 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94bcc16975124f728459d3c28b97f1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172a9e51095e47318b27881dab868355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:10:54.562789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-013d0827-1cd1-4055-b33e-ecc1e6925c34 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 200 len: 1371 microversion: 2.20 time: 0.243853 Jun 23 11:10:54.563885 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 510/1009] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:54 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:10:55.583780 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:55.584786 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:55.591591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:55.592182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:55.593777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:55.594446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:55.608503 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] HTTP exception thrown: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Request method failure captured: Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 HTTP/1.1 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiK2Dmn6GG8VGXTe-C11O4Y0KmEUNxcBj7BFmZjOtVVNkiu56D3IQUP0IPeaMPdaSr_8Uc9-m7Fe0E5tAvWlcQhw_ukuWBvToEvqbA5WhHm7QIIFypfzNxxMI69GT4dnyf-kTVtXN6mrMsnHsrMIBnWbMdec_10WYUIbdpkCSC_9UU Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:10:55.610288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/172a9e51095e47318b27881dab868355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_172a9e51095e47318b27881dab868355", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 94bcc16975124f728459d3c28b97f1a8 Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:55.611806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '248be1ac-b2c3-4081-adba-30258b95aa91'} Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:10:55.613095 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:55.616539 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:55.619105 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Returning 404 to user: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:10:55.619105 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ae68b551-31d3-4864-a081-a10666660c5f tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 404 len: 111 microversion: 2.20 time: 0.032624 Jun 23 11:10:55.625497 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 500/1010] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:55 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:10:55.632420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1e0b8590-5e1b-4150-9830-0574e9614a9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '.version_select at 0x7f089c879ca0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:55.652768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1e0b8590-5e1b-4150-9830-0574e9614a9c tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-624205536" status: 204 len: 0 microversion: 2.20 time: 0.025484 Jun 23 11:10:55.653694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 511/1011] 10.222.0.65 () {60 vars in 1258 bytes} [Thu Jun 23 11:10:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-624205536 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:10:57.804020 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:57.804616 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:57.818626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:57.820331 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:57.821400 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:57.823752 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:57.858129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] HTTP exception thrown: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Request method failure captured: Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 HTTP/1.1 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiK2Dmn6GG8VGXTe-C11O4Y0KmEUNxcBj7BFmZjOtVVNkiu56D3IQUP0IPeaMPdaSr_8Uc9-m7Fe0E5tAvWlcQhw_ukuWBvToEvqbA5WhHm7QIIFypfzNxxMI69GT4dnyf-kTVtXN6mrMsnHsrMIBnWbMdec_10WYUIbdpkCSC_9UU Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:10:57.862446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/172a9e51095e47318b27881dab868355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_172a9e51095e47318b27881dab868355", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 94bcc16975124f728459d3c28b97f1a8 Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.863961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '248be1ac-b2c3-4081-adba-30258b95aa91'} Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:10:57.864734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.865978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.875556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Returning 404 to user: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:10:57.876605 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ebc5d085-8f0a-4da4-9315-85e2494a9200 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 404 len: 111 microversion: 2.20 time: 0.076929 Jun 23 11:10:57.877280 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 501/1012] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Jun 23 11:10:57 2022] DELETE /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:10:57.885582 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:57.886259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 248be1ac-b2c3-4081-adba-30258b95aa91] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:57.897366 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:57.898139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:57.900017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:57.901319 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:57.933041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] HTTP exception thrown: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Request method failure captured: Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 HTTP/1.1 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEiK2Dmn6GG8VGXTe-C11O4Y0KmEUNxcBj7BFmZjOtVVNkiu56D3IQUP0IPeaMPdaSr_8Uc9-m7Fe0E5tAvWlcQhw_ukuWBvToEvqbA5WhHm7QIIFypfzNxxMI69GT4dnyf-kTVtXN6mrMsnHsrMIBnWbMdec_10WYUIbdpkCSC_9UU Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:10:57.939874 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/172a9e51095e47318b27881dab868355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_172a9e51095e47318b27881dab868355", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 94bcc16975124f728459d3c28b97f1a8 Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.941634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '248be1ac-b2c3-4081-adba-30258b95aa91'} Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:10:57.942542 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. Jun 23 11:10:57.944061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:57.945429 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Returning 404 to user: Instance 248be1ac-b2c3-4081-adba-30258b95aa91 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:10:57.945429 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dd8e9c06-8737-4c42-9758-b9d5c177677a tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91" status: 404 len: 111 microversion: 2.20 time: 0.062952 Jun 23 11:10:57.949505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 512/1013] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:57 2022] GET /compute/v2.1/servers/248be1ac-b2c3-4081-adba-30258b95aa91 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:10:59.209289 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:59.209797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:59.216189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:59.216712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:59.217527 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:59.218035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:59.237692 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] HTTP exception thrown: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Request method failure captured: Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 HTTP/1.1 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiK2Dmn6GG8VGXTe-C11O4Y0KmEUNxcBj7BFmZjOtVVNkiu56D3IQUP0IPeaMPdaSr_8Uc9-m7Fe0E5tAvWlcQhw_ukuWBvToEvqbA5WhHm7QIIFypfzNxxMI69GT4dnyf-kTVtXN6mrMsnHsrMIBnWbMdec_10WYUIbdpkCSC_9UU Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:10:59.240281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/172a9e51095e47318b27881dab868355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_172a9e51095e47318b27881dab868355", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 94bcc16975124f728459d3c28b97f1a8 Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.241934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '9d4c91f8-2f76-436d-8b6c-0ab0945961d9'} Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:10:59.242755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.243978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.245566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Returning 404 to user: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:10:59.245566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6fbbf14a-b1e6-4ccc-b28e-74d0b77eae3b tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 404 len: 111 microversion: 2.20 time: 0.036431 Jun 23 11:10:59.245566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 502/1014] 10.222.0.65 () {60 vars in 1279 bytes} [Thu Jun 23 11:10:59 2022] DELETE /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:10:59.251366 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:10:59.257747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] [instance: 9d4c91f8-2f76-436d-8b6c-0ab0945961d9] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:10:59.265217 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:59.265847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:59.266611 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:10:59.267042 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:10:59.292762 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] HTTP exception thrown: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Request method failure captured: Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 HTTP/1.1 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEiK2Dmn6GG8VGXTe-C11O4Y0KmEUNxcBj7BFmZjOtVVNkiu56D3IQUP0IPeaMPdaSr_8Uc9-m7Fe0E5tAvWlcQhw_ukuWBvToEvqbA5WhHm7QIIFypfzNxxMI69GT4dnyf-kTVtXN6mrMsnHsrMIBnWbMdec_10WYUIbdpkCSC_9UU Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:10:59.301626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/172a9e51095e47318b27881dab868355"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_172a9e51095e47318b27881dab868355", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/172a9e51095e47318b27881dab868355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 172a9e51095e47318b27881dab868355 Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1229079191 Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 94bcc16975124f728459d3c28b97f1a8 Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1229079191-project Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.303404 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '9d4c91f8-2f76-436d-8b6c-0ab0945961d9'} Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:10:59.304204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. Jun 23 11:10:59.305528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:10:59.313561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] Returning 404 to user: Instance 9d4c91f8-2f76-436d-8b6c-0ab0945961d9 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:10:59.314800 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ba860d0e-b506-40f0-a8cb-5bbfc1cf60c4 tempest-AttachVolumeShelveTestJSON-1229079191 tempest-AttachVolumeShelveTestJSON-1229079191-project] 10.222.0.65 "GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9" status: 404 len: 111 microversion: 2.20 time: 0.067868 Jun 23 11:10:59.315924 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 513/1015] 10.222.0.65 () {60 vars in 1276 bytes} [Thu Jun 23 11:10:59 2022] GET /compute/v2.1/servers/9d4c91f8-2f76-436d-8b6c-0ab0945961d9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:11:00.161871 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-bc32daaa-cffe-4961-acca-fc406dbe5c14 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Action: 'create', calling method: .version_select at 0x7f089c6a2940>, body: {"keypair": {"name": "tempest-TestShelveInstance-91420173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkxwPYfah/lab29B+VFjVWhE7BCOd+TUvyCl/nDpsrHf1DRFH1NyEJwEfE3zqwJxtKJn6FuvPVvoA+qW3+s4WpFUjBHjmQbWrFthdQC0+J73rLsa3eL2+DXdLMrlCqskg=="}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:00.197170 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-bc32daaa-cffe-4961-acca-fc406dbe5c14 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Getting quotas for project c8040a7c927f4d4ebff4964bc1b63ad7. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:11:00.201706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-bc32daaa-cffe-4961-acca-fc406dbe5c14 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Getting quotas for user 57cabfbd1c494f62b291be319781b071 and project c8040a7c927f4d4ebff4964bc1b63ad7. Resources: {'key_pairs'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:11:00.225983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-bc32daaa-cffe-4961-acca-fc406dbe5c14 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.285413 Jun 23 11:11:00.226656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 503/1016] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:10:59 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:05.272541 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-dca34ad7-b9e0-4edd-8faf-9557d309a5d3 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Action: 'create', calling method: .version_select at 0x7f089c6d23a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1960558486"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:05.685229 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-dca34ad7-b9e0-4edd-8faf-9557d309a5d3 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.751025 Jun 23 11:11:05.692323 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 514/1017] 10.222.0.65 () {60 vars in 1154 bytes} [Thu Jun 23 11:11:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 759 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 11:11:05.697839 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-cedbf9d8-dbaf-4f18-bbf6-49f26117fe2f tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c721af0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:05.761762 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-cedbf9d8-dbaf-4f18-bbf6-49f26117fe2f tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 200 len: 345 microversion: 2.1 time: 0.068208 Jun 23 11:11:05.762323 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 504/1018] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:05 2022] GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:06.774915 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b9536610-7493-4c35-9558-5f4ee354e755 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c5d45e0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:06.823815 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b9536610-7493-4c35-9558-5f4ee354e755 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 200 len: 346 microversion: 2.1 time: 0.053109 Jun 23 11:11:06.824378 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 515/1019] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:06 2022] GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:06.837458 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-caeabb7f-cb29-4497-b87a-ae2792069425 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Action: 'create', calling method: .version_select at 0x7f089cb21c10>, body: {"snapshot": {"volume_id": "8c3409ef-e4d6-4d52-9b3c-4c4298318e5f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-468808574"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:06.990466 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-caeabb7f-cb29-4497-b87a-ae2792069425 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.158798 Jun 23 11:11:06.992343 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 505/1020] 10.222.0.65 () {60 vars in 1161 bytes} [Thu Jun 23 11:11:06 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:07.003288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5f3e6135-d6a9-48cf-8d5a-16e18f89ab5a tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c7f5940>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:07.042053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5f3e6135-d6a9-48cf-8d5a-16e18f89ab5a tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 286 microversion: 2.1 time: 0.043807 Jun 23 11:11:07.042616 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 516/1021] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:06 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:07.053043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a8c1fc52-ae97-4737-9330-32dd9694696c tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c61ea60>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:07.081058 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a8c1fc52-ae97-4737-9330-32dd9694696c tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031580 Jun 23 11:11:07.081845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 506/1022] 10.222.0.65 () {58 vars in 1139 bytes} [Thu Jun 23 11:11:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:07.092271 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-33ce95c6-2457-4e4d-aa38-6c6a57545899 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c6014c0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:07.123718 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-33ce95c6-2457-4e4d-aa38-6c6a57545899 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 286 microversion: 2.1 time: 0.035523 Jun 23 11:11:07.124341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 517/1023] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:07 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:08.136645 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8e961635-290b-4c00-81d5-1da275bb7439 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c6324c0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:08.168100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8e961635-290b-4c00-81d5-1da275bb7439 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 286 microversion: 2.1 time: 0.035893 Jun 23 11:11:08.168667 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 507/1024] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:08 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:09.180202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5e7a2de0-7b53-456a-af95-ab187413514c tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c8108b0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:09.209377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5e7a2de0-7b53-456a-af95-ab187413514c tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 286 microversion: 2.1 time: 0.033483 Jun 23 11:11:09.209919 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 518/1025] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:09 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:10.218521 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:10.219384 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=4 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:10.224065 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-79977dda-0682-4f2a-9b9b-af7da006bab9 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c721af0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:10.229922 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:10.253953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-79977dda-0682-4f2a-9b9b-af7da006bab9 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 286 microversion: 2.1 time: 0.036647 Jun 23 11:11:10.254507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 508/1026] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:10 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:11.262575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:11.263346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=30 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:11.268269 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-22e13a82-4d44-4c62-8806-2f76e9430f14 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c7f5550>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:11.299488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-22e13a82-4d44-4c62-8806-2f76e9430f14 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 287 microversion: 2.1 time: 0.037548 Jun 23 11:11:11.300098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 519/1027] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:11 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:11.311016 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5a77d940-6ddf-4216-a8d1-3dd05123ea44 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c61e700>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:11.366623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5a77d940-6ddf-4216-a8d1-3dd05123ea44 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 202 len: 0 microversion: 2.1 time: 0.059888 Jun 23 11:11:11.367189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 509/1028] 10.222.0.65 () {58 vars in 1253 bytes} [Thu Jun 23 11:11:11 2022] DELETE /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:11:11.375326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e88454a-41d5-4a54-9ef3-c9708ab1e17d tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c8100d0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:11.405157 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e88454a-41d5-4a54-9ef3-c9708ab1e17d tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 200 len: 286 microversion: 2.1 time: 0.033587 Jun 23 11:11:11.406365 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 520/1029] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:11 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:12.418151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-86961fda-35e6-454a-9d76-80099b7a25fe tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c765670>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:12.443100 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-86961fda-35e6-454a-9d76-80099b7a25fe tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] HTTP exception thrown: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-86961fda-35e6-454a-9d76-80099b7a25fe tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Request method failure captured: Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 HTTP/1.1 Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEpIsErs5g62uAfL33G64SsXD99thOGAxCfLZRjmG48PbeFhAlWVBWlA3o7iFV0Ceesy9tDGd8guHNDc7hy3hPuFAVjEU-C50D0wywTNAFO-MxGxCOHnZTXuM-fuEgM7J0oO5Mv4r4KU8Y2VVDdz_cuyiRmIbOztklCb6k2NTY8KfMg Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:11:12.445797 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c2f11f9f5cc4b04bb72e54fc5de2e0d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 566687399b5544de9fc5e11452a5a13b Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '10e449d7-3f05-465a-98e9-c7d1ae523d15'} Jun 23 11:11:12.447684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. (HTTP 404) (Request-ID: req-521195f4-cca8-447e-acc1-8000d09507c0) Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.448739 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:12.450246 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 11:11:12.453127 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-86961fda-35e6-454a-9d76-80099b7a25fe tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Returning 404 to user: Snapshot 10e449d7-3f05-465a-98e9-c7d1ae523d15 could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:11:12.455340 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-86961fda-35e6-454a-9d76-80099b7a25fe tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15" status: 404 len: 111 microversion: 2.1 time: 0.033554 Jun 23 11:11:12.457371 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 510/1030] 10.222.0.65 () {58 vars in 1250 bytes} [Thu Jun 23 11:11:12 2022] GET /compute/v2.1/os-snapshots/10e449d7-3f05-465a-98e9-c7d1ae523d15 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:11:12.457517 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0299b1c2-c671-4a40-9e59-ede67438c0ea tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089eff4ee0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:12.515985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0299b1c2-c671-4a40-9e59-ede67438c0ea tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 202 len: 0 microversion: 2.1 time: 0.063497 Jun 23 11:11:12.516626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 521/1031] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:11:12 2022] DELETE /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:11:12.525247 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fd211bd9-26a2-4aa4-b587-b5fcf18c3f6c tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c61e700>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:12.570853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fd211bd9-26a2-4aa4-b587-b5fcf18c3f6c tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 200 len: 345 microversion: 2.1 time: 0.049440 Jun 23 11:11:12.571405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 511/1032] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:12 2022] GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:13.584786 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3b5cff6-edf3-4dbd-b238-ca82c13f33fa tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c7f5c10>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:13.612048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-b3b5cff6-edf3-4dbd-b238-ca82c13f33fa tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] HTTP exception thrown: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3b5cff6-edf3-4dbd-b238-ca82c13f33fa tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Request method failure captured: Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f HTTP/1.1 Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEpIsErs5g62uAfL33G64SsXD99thOGAxCfLZRjmG48PbeFhAlWVBWlA3o7iFV0Ceesy9tDGd8guHNDc7hy3hPuFAVjEU-C50D0wywTNAFO-MxGxCOHnZTXuM-fuEgM7J0oO5Mv4r4KU8Y2VVDdz_cuyiRmIbOztklCb6k2NTY8KfMg Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:11:13.614015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c2f11f9f5cc4b04bb72e54fc5de2e0d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 566687399b5544de9fc5e11452a5a13b Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '8c3409ef-e4d6-4d52-9b3c-4c4298318e5f'} Jun 23 11:11:13.615593 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. (HTTP 404) (Request-ID: req-3b9ff344-910b-4967-9544-da165446c63f) Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.616641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:13.617894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:11:13.619027 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b3b5cff6-edf3-4dbd-b238-ca82c13f33fa tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Returning 404 to user: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b3b5cff6-edf3-4dbd-b238-ca82c13f33fa tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 404 len: 109 microversion: 2.1 time: 0.035194 Jun 23 11:11:13.620554 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 522/1033] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:13 2022] GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:11:13.625325 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b18672d7-cca0-467a-95b5-6a2c74a66eec tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c7219d0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:13.652548 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-b18672d7-cca0-467a-95b5-6a2c74a66eec tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] HTTP exception thrown: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b18672d7-cca0-467a-95b5-6a2c74a66eec tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Request method failure captured: Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f HTTP/1.1 Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEpIsErs5g62uAfL33G64SsXD99thOGAxCfLZRjmG48PbeFhAlWVBWlA3o7iFV0Ceesy9tDGd8guHNDc7hy3hPuFAVjEU-C50D0wywTNAFO-MxGxCOHnZTXuM-fuEgM7J0oO5Mv4r4KU8Y2VVDdz_cuyiRmIbOztklCb6k2NTY8KfMg Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:11:13.654529 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c2f11f9f5cc4b04bb72e54fc5de2e0d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 566687399b5544de9fc5e11452a5a13b Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '8c3409ef-e4d6-4d52-9b3c-4c4298318e5f'} Jun 23 11:11:13.656205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. (HTTP 404) (Request-ID: req-1adb7202-3819-4436-b6aa-e9f6ca30991a) Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.658330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:11:13.659791 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:11:13.661236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b18672d7-cca0-467a-95b5-6a2c74a66eec tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Returning 404 to user: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:11:13.662621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b18672d7-cca0-467a-95b5-6a2c74a66eec tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 404 len: 109 microversion: 2.1 time: 0.034873 Jun 23 11:11:13.663589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 512/1034] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:11:13 2022] DELETE /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:11:13.664917 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ca8c63f-254b-4869-92ad-0d1c8caaffe4 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Calling method '.version_select at 0x7f089c601160>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:13.693934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-8ca8c63f-254b-4869-92ad-0d1c8caaffe4 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] HTTP exception thrown: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ca8c63f-254b-4869-92ad-0d1c8caaffe4 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Request method failure captured: Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f HTTP/1.1 Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEpIsErs5g62uAfL33G64SsXD99thOGAxCfLZRjmG48PbeFhAlWVBWlA3o7iFV0Ceesy9tDGd8guHNDc7hy3hPuFAVjEU-C50D0wywTNAFO-MxGxCOHnZTXuM-fuEgM7J0oO5Mv4r4KU8Y2VVDdz_cuyiRmIbOztklCb6k2NTY8KfMg Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:11:13.695923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c2f11f9f5cc4b04bb72e54fc5de2e0d", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c2f11f9f5cc4b04bb72e54fc5de2e0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 2c2f11f9f5cc4b04bb72e54fc5de2e0d Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1320367687 Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 566687399b5544de9fc5e11452a5a13b Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1320367687-project Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '8c3409ef-e4d6-4d52-9b3c-4c4298318e5f'} Jun 23 11:11:13.697566 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. (HTTP 404) (Request-ID: req-9af20819-aa1b-4613-a36f-dfd69f2ac596) Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.698672 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:13.700091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:11:13.701571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8ca8c63f-254b-4869-92ad-0d1c8caaffe4 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] Returning 404 to user: Volume 8c3409ef-e4d6-4d52-9b3c-4c4298318e5f could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8ca8c63f-254b-4869-92ad-0d1c8caaffe4 tempest-VolumesSnapshotsTestJSON-1320367687 tempest-VolumesSnapshotsTestJSON-1320367687-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f" status: 404 len: 109 microversion: 2.1 time: 0.036338 Jun 23 11:11:13.702960 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 523/1035] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:13 2022] GET /compute/v2.1/os-volumes/8c3409ef-e4d6-4d52-9b3c-4c4298318e5f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:11:15.164223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-547c4822-7f67-417f-bfca-5620adaa54c3 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Action: 'create', calling method: .version_select at 0x7f089c718820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-188675704", "metadata": {"Type": "work"}}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:15.478565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-547c4822-7f67-417f-bfca-5620adaa54c3 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.437140 Jun 23 11:11:15.479765 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 513/1036] 10.222.0.65 () {60 vars in 1155 bytes} [Thu Jun 23 11:11:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 439 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 11:11:15.491452 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80ec5c23-f066-47df-bc12-d291ad0cda59 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Calling method '.version_select at 0x7f089c879e50>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:15.539283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80ec5c23-f066-47df-bc12-d291ad0cda59 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc" status: 200 len: 352 microversion: 2.1 time: 0.052205 Jun 23 11:11:15.539880 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 524/1037] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:15 2022] GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:16.552828 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-dfff5047-25fb-4513-8395-f3f6de74fae9 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Calling method '.version_select at 0x7f089c7543a0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:16.600269 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-dfff5047-25fb-4513-8395-f3f6de74fae9 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc" status: 200 len: 353 microversion: 2.1 time: 0.051736 Jun 23 11:11:16.600827 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 514/1038] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:16 2022] GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:16.613010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4054294f-6cbd-4261-a7d0-87e6cf3497f3 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Calling method '.version_select at 0x7f089c601d30>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:16.661285 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4054294f-6cbd-4261-a7d0-87e6cf3497f3 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc" status: 200 len: 353 microversion: 2.1 time: 0.053150 Jun 23 11:11:16.661927 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 525/1039] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:16 2022] GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:16.674186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-46c2fdd2-051f-43e4-b0b4-7864f425d660 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Calling method '.version_select at 0x7f089c754f70>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:16.736393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-46c2fdd2-051f-43e4-b0b4-7864f425d660 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc" status: 202 len: 0 microversion: 2.1 time: 0.064409 Jun 23 11:11:16.736393 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 515/1040] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:11:16 2022] DELETE /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:11:16.743431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-039bf5fe-efba-4849-83a2-799c587af3b8 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Calling method '.version_select at 0x7f089c6fcaf0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:16.794243 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-039bf5fe-efba-4849-83a2-799c587af3b8 tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc" status: 200 len: 352 microversion: 2.1 time: 0.054545 Jun 23 11:11:16.794809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 526/1041] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:16 2022] GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:17.806934 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ea4e3d09-bf5b-4891-bcf3-752d2d647abd tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Calling method '.version_select at 0x7f089c7ac670>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:17.834367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-ea4e3d09-bf5b-4891-bcf3-752d2d647abd tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] HTTP exception thrown: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ea4e3d09-bf5b-4891-bcf3-752d2d647abd tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Request method failure captured: Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc HTTP/1.1 Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEpSYKPwgxPSYB2ZsdbswRQH7D5WlnCZ3KHms_dKwf-BKkfpod9bC6uupsHhtjAkak9SNpw-kC067MD7tQe_54j0CyfDkucQMJDWo-XDvQW8lsg1zY5sL-JJiNAIpa9vuCVtyMc9iBcnOtgY-7xi4k6kGHBTQJUdJ1wNB-cstz4-BWw Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 14658ba96fdf443dba893ad98b1c0469 Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-VolumesGetTestJSON-431483202 Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:11:17.837064 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/14658ba96fdf443dba893ad98b1c0469"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/14658ba96fdf443dba893ad98b1c0469"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_14658ba96fdf443dba893ad98b1c0469", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/14658ba96fdf443dba893ad98b1c0469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-VolumesGetTestJSON-431483202 Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 14658ba96fdf443dba893ad98b1c0469 Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-VolumesGetTestJSON-431483202 Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-VolumesGetTestJSON-431483202-project Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: d6238b3ebf184f939cc0b4bb934b328f Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-VolumesGetTestJSON-431483202-project Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '49fd3ba2-7935-414a-b47a-1d5d282145dc'} Jun 23 11:11:17.838636 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. (HTTP 404) (Request-ID: req-b173e8df-268e-4710-adc6-bc381be1d967) Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:17.839555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:11:17.840948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:11:17.842308 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ea4e3d09-bf5b-4891-bcf3-752d2d647abd tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] Returning 404 to user: Volume 49fd3ba2-7935-414a-b47a-1d5d282145dc could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ea4e3d09-bf5b-4891-bcf3-752d2d647abd tempest-VolumesGetTestJSON-431483202 tempest-VolumesGetTestJSON-431483202-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc" status: 404 len: 109 microversion: 2.1 time: 0.035214 Jun 23 11:11:17.843626 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 516/1042] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:17 2022] GET /compute/v2.1/os-volumes/49fd3ba2-7935-414a-b47a-1d5d282145dc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:11:21.009095 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-78d32951-964f-47cc-8d6a-cbdd50038e15 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c6b6280>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:21.060632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-78d32951-964f-47cc-8d6a-cbdd50038e15 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/3656d14e-4948-4327-8fe5-95983bf557fa" status: 200 len: 351 microversion: 2.1 time: 0.055151 Jun 23 11:11:21.061193 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 527/1043] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:21 2022] GET /compute/v2.1/os-volumes/3656d14e-4948-4327-8fe5-95983bf557fa => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:22.394431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-081e7e52-7b8d-44c3-b79c-74a4ff7d54a6 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c7ac430>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:22.444552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-081e7e52-7b8d-44c3-b79c-74a4ff7d54a6 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/9b4cb27f-6a30-47f5-bca0-14d56386a6d9" status: 200 len: 351 microversion: 2.1 time: 0.055536 Jun 23 11:11:22.445231 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 517/1044] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:22 2022] GET /compute/v2.1/os-volumes/9b4cb27f-6a30-47f5-bca0-14d56386a6d9 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:22.518627 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2100015944", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-91420173", "security_groups": [{"name": "tempest-secgroup-smoke-218491231"}], "networks": [{"uuid": "6428178e-b2c3-4ed8-8208-a2488665a794"}], "block_device_mapping_v2": [{"uuid": "51d987c4-f1fd-405b-aba5-690eb23a88ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:22.639335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.network.neutron [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] validate_networks() for [('6428178e-b2c3-4ed8-8208-a2488665a794', None, None, None, None, None)] {{(pid=117877) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:11:23.043962 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Flavor limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:11:23.044457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Image limits 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:11:23.045006 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Flavor pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:11:23.045488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Image pref 0:0:0 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:11:23.046101 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.virt.hardware [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117877) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:11:23.055479 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:23.056180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:23.057055 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:23.057561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:23.075630 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Getting quotas for project c8040a7c927f4d4ebff4964bc1b63ad7. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:11:23.080267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Getting quotas for user 57cabfbd1c494f62b291be319781b071 and project c8040a7c927f4d4ebff4964bc1b63ad7. Resources: {'cores', 'ram', 'instances'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:11:23.146708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Going to run 1 instances... {{(pid=117877) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:11:23.149116 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51d987c4-f1fd-405b-aba5-690eb23a88ed',volume_size=None,volume_type=None)] {{(pid=117877) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:11:23.280853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-b35a9fe7-b9e4-4988-bee3-b89ee1ba6623 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768247 Jun 23 11:11:23.281561 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 528/1045] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:11:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:11:23.292131 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-49a9dea2-b1b7-4b94-a1a6-55648688c88e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:23.292883 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-49a9dea2-b1b7-4b94-a1a6-55648688c88e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:23.358837 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-49a9dea2-b1b7-4b94-a1a6-55648688c88e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:23.368469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-49a9dea2-b1b7-4b94-a1a6-55648688c88e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1087 microversion: 2.1 time: 0.079345 Jun 23 11:11:23.369116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 518/1046] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:23 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:23.831455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-633549b4-4ec1-4a43-8138-7a2b6b1f68a9 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c879820>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:23.882510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-633549b4-4ec1-4a43-8138-7a2b6b1f68a9 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/517c080a-51c4-4261-aed9-d40f16241641" status: 200 len: 350 microversion: 2.1 time: 0.055803 Jun 23 11:11:23.883159 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 529/1047] 10.222.0.65 () {58 vars in 1244 bytes} [Thu Jun 23 11:11:23 2022] GET /compute/v2.1/os-volumes/517c080a-51c4-4261-aed9-d40f16241641 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:23.899228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-641e7094-39c8-4b06-adc3-5325e1c519ba tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c754430>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:23.997982 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-641e7094-39c8-4b06-adc3-5325e1c519ba tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.106001 Jun 23 11:11:23.998549 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 519/1048] 10.222.0.65 () {58 vars in 1133 bytes} [Thu Jun 23 11:11:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:24.011421 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-619ca8ea-80ec-4620-96bd-f335e376bfab tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089eff44c0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.093708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-619ca8ea-80ec-4620-96bd-f335e376bfab tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086250 Jun 23 11:11:24.101207 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 530/1049] 10.222.0.65 () {58 vars in 1148 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:24.106061 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-746f58e3-9f5d-40d6-ba34-7f0146e7627b tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c80e280>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.193938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-746f58e3-9f5d-40d6-ba34-7f0146e7627b tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091388 Jun 23 11:11:24.196113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 520/1050] 10.222.0.65 () {58 vars in 1133 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:24.208543 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5c5b4ba4-11ad-42c6-9c56-243f2d9f13f8 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c6fcaf0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.296142 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5c5b4ba4-11ad-42c6-9c56-243f2d9f13f8 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093752 Jun 23 11:11:24.296699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 531/1051] 10.222.0.65 () {58 vars in 1166 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:24.310030 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6717affc-8e9b-4a7d-b0af-3e801e776121 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c721f70>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.396462 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6717affc-8e9b-4a7d-b0af-3e801e776121 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090380 Jun 23 11:11:24.397792 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 521/1052] 10.222.0.65 () {58 vars in 1169 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:24.410437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7bec8069-186c-4ef8-8c99-e055eae961ac tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c754700>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.414894 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.416039 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:24.428039 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:24.428779 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:24.429764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:24.430397 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:24.511140 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7bec8069-186c-4ef8-8c99-e055eae961ac tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.105295 Jun 23 11:11:24.511749 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 522/1053] 10.222.0.65 () {58 vars in 1154 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:24.520196 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:24.522744 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3bd12c07-2205-4809-b4a0-9e152814e574 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c80ef70>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.530255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fc62e643-c888-4ebf-b5ec-809b0e383ea4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1203 microversion: 2.1 time: 0.144775 Jun 23 11:11:24.531034 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 532/1054] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1203 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:24.637062 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3bd12c07-2205-4809-b4a0-9e152814e574 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.118140 Jun 23 11:11:24.637629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 523/1055] 10.222.0.65 () {58 vars in 1187 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:11:24.651053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7e00d8cd-c6b1-41de-89c8-c45470b492f6 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] Calling method '.version_select at 0x7f089c72bdc0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:24.735950 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7e00d8cd-c6b1-41de-89c8-c45470b492f6 tempest-VolumesTestJSON-229836011 tempest-VolumesTestJSON-229836011-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089064 Jun 23 11:11:24.736952 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 533/1056] 10.222.0.65 () {58 vars in 1154 bytes} [Thu Jun 23 11:11:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:25.550987 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:25.551680 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:25.558831 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:25.559403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:25.560306 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:25.560971 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:25.703560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:25.718671 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-35ac7366-23eb-42d3-b694-d0a05ad23fd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.173544 Jun 23 11:11:25.731518 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 524/1057] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:25 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:25.970451 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-af513f2a-0f15-4b04-a719-547d5584dd26 req-dead1e10-6674-4136-b25f-6d58aab6a145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:25.987768 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-af513f2a-0f15-4b04-a719-547d5584dd26 req-dead1e10-6674-4136-b25f-6d58aab6a145 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:25.988487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-af513f2a-0f15-4b04-a719-547d5584dd26 req-dead1e10-6674-4136-b25f-6d58aab6a145 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:26.007673 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-af513f2a-0f15-4b04-a719-547d5584dd26 req-dead1e10-6674-4136-b25f-6d58aab6a145 service nova] Creating event network-changed:72bdff1f-006b-46d7-8a00-abb368b12ebb for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d on hv-cinder-84330 Jun 23 11:11:26.023812 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-af513f2a-0f15-4b04-a719-547d5584dd26 req-dead1e10-6674-4136-b25f-6d58aab6a145 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059657 Jun 23 11:11:26.024941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 534/1058] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:26.736688 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:26.737511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:26.743735 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:26.744263 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:26.745138 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:26.745639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:26.883033 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:26.892809 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f542de8d-cefe-4a0a-9b2f-272d72f7d46e tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.160685 Jun 23 11:11:26.902449 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 525/1059] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:26 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:27.910696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:27.911560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:27.919457 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:27.919823 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:27.920586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:27.921016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:28.063938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:28.071510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e8fed95-a2fd-423d-b9f6-39529f2f745c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.165653 Jun 23 11:11:28.072328 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 535/1060] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:27 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:29.092378 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:29.093464 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:29.104251 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:29.104767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:29.105619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:29.106124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:29.252819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:29.261236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-00076e3e-a0a0-4462-9182-5c91e0adcd53 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.175556 Jun 23 11:11:29.262133 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 526/1061] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:29 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:30.279417 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:30.280839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:30.287860 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:30.288309 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:30.289204 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:30.289720 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:30.432659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:30.440256 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2e9652dc-b024-4947-88bb-37425f1e044f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.164907 Jun 23 11:11:30.440837 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 536/1062] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:30 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:31.458607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:31.459143 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:31.465594 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:31.466047 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:31.466814 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:31.467254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:31.597298 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:31.605496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ad1ee9ba-e1bf-48b9-a77c-3e65f3f0388f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.151300 Jun 23 11:11:31.606056 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 527/1063] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:31 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:32.622817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:32.623454 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:32.630060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:32.630500 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:32.631265 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:32.631706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:32.768628 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:32.776197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-df41a895-3366-4126-b0a8-23d2374cba9d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.157318 Jun 23 11:11:32.776746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 537/1064] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:32 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:33.793021 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:33.793638 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:33.796259 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:33.802566 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:33.802806 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:33.803633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:33.804267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:33.993988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:34.001507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9458fc31-abf1-4ba9-a6ff-9cba9b6271d4 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.212261 Jun 23 11:11:34.002396 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 528/1065] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:33 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:35.018747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:35.019437 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:35.022022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:35.022699 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:35.035179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:35.036068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:35.037849 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:35.038371 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:35.171270 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:35.178596 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-e66eb49b-7dd0-43f3-93aa-87748dbd98a3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.163829 Jun 23 11:11:35.179149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 538/1066] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:35 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:36.195560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:36.196200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:36.202679 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:36.203116 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:36.203890 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:36.204321 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:36.338376 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:36.346538 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8f81c23a-f39f-44a0-be34-2c40fb023026 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.154828 Jun 23 11:11:36.347106 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 529/1067] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:36 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:37.363876 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:37.364476 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:37.371215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:37.371675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:37.372479 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:37.372977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:37.501601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:37.508988 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-acc9ba13-e242-4900-9088-2997e332990c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.149571 Jun 23 11:11:37.509540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 539/1068] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:37 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:38.525999 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:38.526786 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:38.533652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:38.534225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:38.535115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:38.535617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:38.668754 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:38.676921 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d5ddd22a-2c5d-42bf-81f4-a993e4482c65 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.155442 Jun 23 11:11:38.677494 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 530/1069] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:38 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:38.961029 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-b0cc94e5-03b7-4b9a-8d4e-0cb5085e004e req-f70db115-4de9-4876-9d27-b352818a3107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "name": "network-vif-plugged", "status": "completed", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:38.970259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b0cc94e5-03b7-4b9a-8d4e-0cb5085e004e req-f70db115-4de9-4876-9d27-b352818a3107 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:38.970704 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-b0cc94e5-03b7-4b9a-8d4e-0cb5085e004e req-f70db115-4de9-4876-9d27-b352818a3107 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:38.981736 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-b0cc94e5-03b7-4b9a-8d4e-0cb5085e004e req-f70db115-4de9-4876-9d27-b352818a3107 service nova] Creating event network-vif-plugged:72bdff1f-006b-46d7-8a00-abb368b12ebb for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d on hv-cinder-84330 Jun 23 11:11:38.987910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-b0cc94e5-03b7-4b9a-8d4e-0cb5085e004e req-f70db115-4de9-4876-9d27-b352818a3107 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030587 Jun 23 11:11:38.988540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 540/1070] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:39.694405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:39.694941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:39.701348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:39.701792 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:39.702637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:39.703039 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:39.841344 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:39.850976 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-df6e49c4-2168-4c80-a3f3-0209a04b6c7d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1258 microversion: 2.1 time: 0.160276 Jun 23 11:11:39.851559 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 531/1071] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:39 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:40.869295 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:40.869993 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:40.876271 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:40.876729 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:40.878084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:40.878529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:41.035308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:41.043592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0b381b28-e788-4e5a-8d41-a65c5021b439 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1442 microversion: 2.1 time: 0.178945 Jun 23 11:11:41.044192 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 541/1072] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:40 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1442 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:41.064788 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:41.065674 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:41.072693 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:41.073219 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:41.074382 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:41.074521 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:41.244927 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:41.252470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3b18c2ac-29e3-431e-b55c-bb0542a22cec tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1442 microversion: 2.1 time: 0.196328 Jun 23 11:11:41.253029 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 532/1073] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:41 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1442 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:11:43.300339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-e3ec6f8b-626a-45b5-9f36-48eaa70e4931 req-aa9f37c6-0824-4994-96d7-f0c3411e33ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:43.308709 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-e3ec6f8b-626a-45b5-9f36-48eaa70e4931 req-aa9f37c6-0824-4994-96d7-f0c3411e33ee service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:43.309155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-e3ec6f8b-626a-45b5-9f36-48eaa70e4931 req-aa9f37c6-0824-4994-96d7-f0c3411e33ee service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:43.319928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-e3ec6f8b-626a-45b5-9f36-48eaa70e4931 req-aa9f37c6-0824-4994-96d7-f0c3411e33ee service nova] Creating event network-changed:72bdff1f-006b-46d7-8a00-abb368b12ebb for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d on hv-cinder-84330 Jun 23 11:11:43.324948 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-e3ec6f8b-626a-45b5-9f36-48eaa70e4931 req-aa9f37c6-0824-4994-96d7-f0c3411e33ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028289 Jun 23 11:11:43.325856 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 542/1074] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:48.079334 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1455080812", "imageRef": "78a18f55-bfc1-4413-bcaf-e14146080f12", "flavorRef": "452"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:48.128448 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] validate_networks() for None {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:11:48.648512 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:11:48.648935 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:11:48.649405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:11:48.649817 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:11:48.650223 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:11:48.659124 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:48.659569 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:48.660398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:48.660832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:48.676839 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Getting quotas for project f5c3243de4c94fe99d6dd7f96c814e62. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:11:48.680732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Getting quotas for user 851f30b7cc36417986029dfcc40b124f and project f5c3243de4c94fe99d6dd7f96c814e62. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:11:48.691769 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:11:48.693980 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78a18f55-bfc1-4413-bcaf-e14146080f12',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:11:48.738577 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-96b849ec-f206-4e57-8bb7-c56d0fbee76f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663002 Jun 23 11:11:48.739220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 533/1075] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:11:48.750323 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cc54a795-33a6-4224-a00a-2b0028fd70f4 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:48.751018 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cc54a795-33a6-4224-a00a-2b0028fd70f4 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:48.804039 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc54a795-33a6-4224-a00a-2b0028fd70f4 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:48.810798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cc54a795-33a6-4224-a00a-2b0028fd70f4 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1215 microversion: 2.1 time: 0.065352 Jun 23 11:11:48.811377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 543/1076] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:48 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:11:49.829082 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:49.833186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:49.839793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:49.840479 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:49.841262 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:49.841703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:49.904232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:49.912429 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-d4bd93e3-2bdf-456a-a993-2cf470f7d8fe tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1273 microversion: 2.1 time: 0.087742 Jun 23 11:11:49.913266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 534/1077] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:49 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:50.930370 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:50.930983 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:50.938178 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:50.938626 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:50.939390 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:50.939850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:51.143776 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:51.152531 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d6b25ebe-6ef4-4db0-9c92-e18eed029c2e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.226665 Jun 23 11:11:51.153191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 544/1078] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:50 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:51.338839 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-122766dc-e339-4f0d-96f0-11315b0b6968 req-69c5d0dc-3049-493b-a43f-6441f9017ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f75764b9-4196-49a1-86ed-a640b0552344", "tag": "7ac91e8e-5154-4684-83b3-cc2d203cb0b2"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:51.361660 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-122766dc-e339-4f0d-96f0-11315b0b6968 req-69c5d0dc-3049-493b-a43f-6441f9017ffe service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:51.362088 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-122766dc-e339-4f0d-96f0-11315b0b6968 req-69c5d0dc-3049-493b-a43f-6441f9017ffe service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:51.374883 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-122766dc-e339-4f0d-96f0-11315b0b6968 req-69c5d0dc-3049-493b-a43f-6441f9017ffe service nova] Creating event network-changed:7ac91e8e-5154-4684-83b3-cc2d203cb0b2 for instance f75764b9-4196-49a1-86ed-a640b0552344 on hv-cinder-84330 Jun 23 11:11:51.380706 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-122766dc-e339-4f0d-96f0-11315b0b6968 req-69c5d0dc-3049-493b-a43f-6441f9017ffe service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054111 Jun 23 11:11:51.381403 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 535/1079] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:11:52.170322 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:52.170963 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:52.177942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:52.178392 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:52.179155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:52.179599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:52.309277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:52.316769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-af2f063c-ac9d-4f5e-82ea-69dd69220e7e tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.150521 Jun 23 11:11:52.317320 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 545/1080] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:52 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:53.334712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:53.335335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:53.337767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:53.343265 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:53.343737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:53.344501 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:53.344938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:53.349726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=65 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:53.470525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:53.477830 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f228a093-744a-43d7-9c5a-c9f4034f9c17 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.148051 Jun 23 11:11:53.478389 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 536/1081] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:53 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:54.494839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:54.495474 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:54.497862 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:54.503135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:54.503570 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:54.504965 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:54.505388 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:54.510604 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=63 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:54.636030 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:54.644459 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8233709f-9e8b-498e-9a74-eaa0c003f638 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.153355 Jun 23 11:11:54.645022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 546/1082] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:54 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:55.661836 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:55.662450 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:55.668926 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:55.669381 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:55.670159 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:55.670600 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:55.797990 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:55.805814 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-24c93480-f76b-42ba-b205-6714fd7ce7d6 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.148360 Jun 23 11:11:55.806372 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 537/1083] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:55 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:56.822801 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:56.823398 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:56.829501 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:56.829937 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:56.830710 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:56.831133 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:57.090010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-a3dacef6-0491-47fb-86be-082bfdec2f59 req-78670493-fbf7-4ae1-b142-d9b10ceeb5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75764b9-4196-49a1-86ed-a640b0552344", "name": "network-vif-plugged", "status": "completed", "tag": "7ac91e8e-5154-4684-83b3-cc2d203cb0b2"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:11:57.103546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-a3dacef6-0491-47fb-86be-082bfdec2f59 req-78670493-fbf7-4ae1-b142-d9b10ceeb5df service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:57.104003 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-a3dacef6-0491-47fb-86be-082bfdec2f59 req-78670493-fbf7-4ae1-b142-d9b10ceeb5df service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:57.116819 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-a3dacef6-0491-47fb-86be-082bfdec2f59 req-78670493-fbf7-4ae1-b142-d9b10ceeb5df service nova] Creating event network-vif-plugged:7ac91e8e-5154-4684-83b3-cc2d203cb0b2 for instance f75764b9-4196-49a1-86ed-a640b0552344 on hv-cinder-84330 Jun 23 11:11:57.122160 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-a3dacef6-0491-47fb-86be-082bfdec2f59 req-78670493-fbf7-4ae1-b142-d9b10ceeb5df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036049 Jun 23 11:11:57.122718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 538/1084] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:11:57.137191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:57.145527 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f614973f-1c6a-4fa1-ae36-4bc702532104 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.325924 Jun 23 11:11:57.146173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 547/1085] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:56 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:58.164750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:58.165436 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:58.171610 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:58.172083 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:58.172832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:58.173260 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:58.353840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:58.361257 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9316e18b-c0db-4014-b56e-849541dee141 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1315 microversion: 2.1 time: 0.202164 Jun 23 11:11:58.362036 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 539/1086] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:58 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:59.377916 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:59.378520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:59.380943 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:59.386577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:59.387023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:59.387807 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:59.388238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:59.516503 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:59.524773 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e2a1476-10c0-47dc-a2f5-57e67cfbf6de tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1464 microversion: 2.1 time: 0.150784 Jun 23 11:11:59.525324 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 548/1087] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:59 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1464 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:11:59.562779 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:59.563270 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:59.565207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:59.566042 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=6 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:59.572034 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:59.572482 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:59.573281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:59.573712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:59.598640 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:11:59.670546 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-641618ed-a3fd-4953-a0f7-04f65cb8c46f tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 204 len: 0 microversion: 2.1 time: 0.111342 Jun 23 11:11:59.671117 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 540/1088] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:11:59 2022] DELETE /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:11:59.680202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:11:59.680822 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:11:59.686717 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:59.687162 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:59.687951 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:11:59.688381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:11:59.813352 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:11:59.828609 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6da37de0-6df9-4386-afae-3df4e5657c18 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1470 microversion: 2.1 time: 0.152436 Jun 23 11:11:59.829183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 549/1089] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:11:59 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:00.846845 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:00.847543 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:00.854563 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:00.855007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:00.855804 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:00.856241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:00.984595 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:00.992794 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-3c1b7cd4-7f3c-4b07-aa41-0136d5e5acf2 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1470 microversion: 2.1 time: 0.150154 Jun 23 11:12:00.993390 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 541/1090] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:00 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:01.831060 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-9a6b9775-c00e-45e9-afe3-41bb0af27b16 req-93ef1a4d-6166-4dfb-b286-2f1b8dbb3207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f75764b9-4196-49a1-86ed-a640b0552344", "name": "network-vif-deleted", "tag": "7ac91e8e-5154-4684-83b3-cc2d203cb0b2"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:01.842143 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9a6b9775-c00e-45e9-afe3-41bb0af27b16 req-93ef1a4d-6166-4dfb-b286-2f1b8dbb3207 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:01.842657 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9a6b9775-c00e-45e9-afe3-41bb0af27b16 req-93ef1a4d-6166-4dfb-b286-2f1b8dbb3207 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:01.856631 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-9a6b9775-c00e-45e9-afe3-41bb0af27b16 req-93ef1a4d-6166-4dfb-b286-2f1b8dbb3207 service nova] Creating event network-vif-deleted:7ac91e8e-5154-4684-83b3-cc2d203cb0b2 for instance f75764b9-4196-49a1-86ed-a640b0552344 on hv-cinder-84330 Jun 23 11:12:01.862910 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-9a6b9775-c00e-45e9-afe3-41bb0af27b16 req-93ef1a4d-6166-4dfb-b286-2f1b8dbb3207 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034766 Jun 23 11:12:01.863702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 550/1091] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:02.010560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:02.011158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:02.017619 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:02.018070 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:02.018840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:02.019279 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:02.050782 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:02.051204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:02.051648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lazy-loading 'fault' on Instance uuid f75764b9-4196-49a1-86ed-a640b0552344 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:12:02.092097 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '851f30b7cc36417986029dfcc40b124f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c3243de4c94fe99d6dd7f96c814e62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:02.099571 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5c02e5e5-a2fc-446a-bb4e-76deae066dbb tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 200 len: 1305 microversion: 2.1 time: 0.093022 Jun 23 11:12:02.100158 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 542/1092] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:02 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:03.117135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:03.117835 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] [instance: f75764b9-4196-49a1-86ed-a640b0552344] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:03.124573 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:03.125025 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:03.125791 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:03.126255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:03.140099 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] HTTP exception thrown: Instance f75764b9-4196-49a1-86ed-a640b0552344 could not be found. Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Request method failure captured: Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 HTTP/1.1 Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEpyExDk4aZ-FQj5RJtdozdx9p09tas3-vav7QKvwml5tKLyFPIPMmOYHdWotoKbV-2g-PS8uEPA1AgqJYTpCr7M_UBYO9w3fAIUSM2IS8YDe3TgdQVcVoTzIZZuOnUp8C-HE-Y_GfIIIVoke9mpcHBiXsD7TY9Cpk_SiecKVnC_TJw Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: f5c3243de4c94fe99d6dd7f96c814e62 Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-VolumesNegativeTest-1880975569 Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:12:03.141761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f5c3243de4c94fe99d6dd7f96c814e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f5c3243de4c94fe99d6dd7f96c814e62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f5c3243de4c94fe99d6dd7f96c814e62", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f5c3243de4c94fe99d6dd7f96c814e62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-VolumesNegativeTest-1880975569 Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: f5c3243de4c94fe99d6dd7f96c814e62 Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-VolumesNegativeTest-1880975569 Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-VolumesNegativeTest-1880975569-project Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 851f30b7cc36417986029dfcc40b124f Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-VolumesNegativeTest-1880975569-project Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance f75764b9-4196-49a1-86ed-a640b0552344 could not be found. Jun 23 11:12:03.143892 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': 'f75764b9-4196-49a1-86ed-a640b0552344'} Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f75764b9-4196-49a1-86ed-a640b0552344 could not be found. Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:12:03.145560 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f75764b9-4196-49a1-86ed-a640b0552344 could not be found. Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f75764b9-4196-49a1-86ed-a640b0552344 could not be found. Jun 23 11:12:03.147505 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:03.149180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] Returning 404 to user: Instance f75764b9-4196-49a1-86ed-a640b0552344 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:12:03.149180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-779ad6b1-2402-437e-856d-71478217d5a7 tempest-VolumesNegativeTest-1880975569 tempest-VolumesNegativeTest-1880975569-project] 10.222.0.65 "GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344" status: 404 len: 111 microversion: 2.1 time: 0.030278 Jun 23 11:12:03.149180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 551/1093] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:03 2022] GET /compute/v2.1/servers/f75764b9-4196-49a1-86ed-a640b0552344 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:19.232988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:19.234094 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:19.236698 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-a1bf317b-ae95-40a8-a826-5ed090f0a2f3 req-80c07402-f9fd-48f4-925f-54559798b127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a71f3-1252-4ffa-bf80-909aac0f8abe", "tag": "242b880a-a6ce-40f9-922e-b675d23563b9"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:19.242129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=11 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:19.245577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=27 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:19.246266 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:19.248547 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:19.250889 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:19.252152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:19.253757 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:19.255137 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:19.269463 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a1bf317b-ae95-40a8-a826-5ed090f0a2f3 req-80c07402-f9fd-48f4-925f-54559798b127 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:19.269903 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-a1bf317b-ae95-40a8-a826-5ed090f0a2f3 req-80c07402-f9fd-48f4-925f-54559798b127 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:19.293878 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-a1bf317b-ae95-40a8-a826-5ed090f0a2f3 req-80c07402-f9fd-48f4-925f-54559798b127 service nova] Creating event network-changed:242b880a-a6ce-40f9-922e-b675d23563b9 for instance d93a71f3-1252-4ffa-bf80-909aac0f8abe on hv-cinder-84330 Jun 23 11:12:19.302942 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:12:19.321103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-a1bf317b-ae95-40a8-a826-5ed090f0a2f3 req-80c07402-f9fd-48f4-925f-54559798b127 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087932 Jun 23 11:12:19.334105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 552/1094] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:19.409949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6424bf09-48bf-41b5-bd72-d27aee39aa0c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 204 len: 0 microversion: 2.1 time: 0.181985 Jun 23 11:12:19.414215 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 543/1095] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:12:19 2022] DELETE /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:12:19.419766 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:19.420525 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:19.433186 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:19.443576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:19.444677 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:19.447839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:19.637790 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:19.648126 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-409783f9-477d-410f-8a08-016c53704306 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1579 microversion: 2.1 time: 0.232255 Jun 23 11:12:19.648928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 553/1096] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:19 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1579 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:20.666724 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:20.667422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:20.678654 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:20.679207 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:20.681025 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:20.681589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:20.884899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:20.893240 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1410b4f6-c9e7-4966-93af-6ab966f12698 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1579 microversion: 2.1 time: 0.230665 Jun 23 11:12:20.894199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 544/1097] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:20 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1579 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:21.913481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:21.914246 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:21.922277 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:21.924829 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:21.926104 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:21.928010 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:22.209490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-5a7d10bc-140e-4812-b0fc-486b9ad75cb9 req-ed734d9e-b66c-4063-b4bd-d310bfb16063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a71f3-1252-4ffa-bf80-909aac0f8abe", "name": "network-vif-deleted", "tag": "242b880a-a6ce-40f9-922e-b675d23563b9"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:22.224587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:22.234110 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1d5c5e8a-db99-42a6-b8f6-934640a78b03 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1460 microversion: 2.1 time: 0.325156 Jun 23 11:12:22.234689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 554/1098] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:21 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1460 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:22.235502 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5a7d10bc-140e-4812-b0fc-486b9ad75cb9 req-ed734d9e-b66c-4063-b4bd-d310bfb16063 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:22.236224 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-5a7d10bc-140e-4812-b0fc-486b9ad75cb9 req-ed734d9e-b66c-4063-b4bd-d310bfb16063 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:22.258122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-5a7d10bc-140e-4812-b0fc-486b9ad75cb9 req-ed734d9e-b66c-4063-b4bd-d310bfb16063 service nova] Creating event network-vif-deleted:242b880a-a6ce-40f9-922e-b675d23563b9 for instance d93a71f3-1252-4ffa-bf80-909aac0f8abe on hv-cinder-84330 Jun 23 11:12:22.264963 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-5a7d10bc-140e-4812-b0fc-486b9ad75cb9 req-ed734d9e-b66c-4063-b4bd-d310bfb16063 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058700 Jun 23 11:12:22.265229 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 545/1099] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:23.252431 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:23.254038 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:23.262346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:23.263137 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:23.264270 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:23.264795 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:23.318614 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:23.319180 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:23.319724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.objects.instance [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lazy-loading 'fault' on Instance uuid d93a71f3-1252-4ffa-bf80-909aac0f8abe {{(pid=117877) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:12:23.366493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:23.375063 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2b0ab617-dff6-4e69-8866-a33d1af4bc67 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 200 len: 1184 microversion: 2.1 time: 0.126525 Jun 23 11:12:23.375761 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 555/1100] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:23 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 1184 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:24.393382 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:24.394810 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: d93a71f3-1252-4ffa-bf80-909aac0f8abe] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:24.404281 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:24.405053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:24.406027 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:24.406672 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:24.423318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] HTTP exception thrown: Instance d93a71f3-1252-4ffa-bf80-909aac0f8abe could not be found. Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Request method failure captured: Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe HTTP/1.1 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiTs3EDFLedpTk3rElAAOIJxn-UfNxTeaIOWo6NQY87-0BbIhQZy3UrULU03Vif_77fqF8PADrAiw1xzoqQ6XbB_iCYTzn7vq-KSWsdWUkJ6ynNOI71W_fLQjdD_BbUEZMQc0ijEFz11dE9QSz4SxpLKwJeUQnxW7YGOBa8zvnq624 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:12:24.425104 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1fccc592269f433b99c2d13dad5e8e39", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 8f8da2142b9e4751b436cfd4920587a0 Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance d93a71f3-1252-4ffa-bf80-909aac0f8abe could not be found. Jun 23 11:12:24.427691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': 'd93a71f3-1252-4ffa-bf80-909aac0f8abe'} Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93a71f3-1252-4ffa-bf80-909aac0f8abe could not be found. Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:12:24.428970 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93a71f3-1252-4ffa-bf80-909aac0f8abe could not be found. Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93a71f3-1252-4ffa-bf80-909aac0f8abe could not be found. Jun 23 11:12:24.430650 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:24.432075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Returning 404 to user: Instance d93a71f3-1252-4ffa-bf80-909aac0f8abe could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:12:24.432075 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-02bad2ae-a2e5-4cb7-a201-fc4547f32fdd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe" status: 404 len: 111 microversion: 2.1 time: 0.039828 Jun 23 11:12:24.433016 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 546/1101] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:24 2022] GET /compute/v2.1/servers/d93a71f3-1252-4ffa-bf80-909aac0f8abe => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:26.877376 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2fe4a3f-6772-43e6-804d-87908c542e38 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Action: 'create', calling method: .version_select at 0x7f089c7f58b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-743017024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtT+eTLvN/y0iOuWfrtneC9AIKBQB+HLoBr3buHBrzn6A3MWB809bvzER2qrgauGE1qMJqaZYGzw9ah4FqX4d+dwsEgRNKSwk0hhrQkL0AYYfSqTPCUTn8CX38gr8UtMQ=="}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:26.891942 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-d2fe4a3f-6772-43e6-804d-87908c542e38 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Getting quotas for project 0d0d343d1ec648a981cc8d7910b92401. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:12:26.896473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.quota [None req-d2fe4a3f-6772-43e6-804d-87908c542e38 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Getting quotas for user 7d3495251b56423fbe694d5cb7ef4695 and project 0d0d343d1ec648a981cc8d7910b92401. Resources: {'key_pairs'} {{(pid=117877) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:12:26.918540 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2fe4a3f-6772-43e6-804d-87908c542e38 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045053 Jun 23 11:12:26.919297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 556/1102] 10.222.0.65 () {60 vars in 1158 bytes} [Thu Jun 23 11:12:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:12:26.968144 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-811808835", "imageRef": "2cad8b0e-e416-4e19-956f-5bece835233b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-743017024", "networks": [{"uuid": "b2108bfc-df89-4f9b-a4b8-341ca203eb2f"}]}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:27.017571 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.network.neutron [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] validate_networks() for [('b2108bfc-df89-4f9b-a4b8-341ca203eb2f', None, None, None, None, None)] {{(pid=117878) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:12:27.404109 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Flavor limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:12:27.404740 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Image limits 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:12:27.405214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Flavor pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:12:27.405625 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Image pref 0:0:0 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:12:27.406031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.virt.hardware [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117878) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:12:27.415010 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.415572 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.416446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.416885 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.435300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Getting quotas for project 0d0d343d1ec648a981cc8d7910b92401. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:12:27.439235 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.quota [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Getting quotas for user 7d3495251b56423fbe694d5cb7ef4695 and project 0d0d343d1ec648a981cc8d7910b92401. Resources: {'cores', 'ram', 'instances'} {{(pid=117878) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:12:27.450727 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Going to run 1 instances... {{(pid=117878) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:12:27.453123 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cad8b0e-e416-4e19-956f-5bece835233b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117878) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:12:27.498217 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-238f74ca-20d6-45c0-8217-e3c4ef64d9e1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533871 Jun 23 11:12:27.499045 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 547/1103] 10.222.0.65 () {60 vars in 1146 bytes} [Thu Jun 23 11:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:12:27.509114 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-085250d7-1be5-4271-8bf0-7fb41b314fdf tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:27.509839 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-085250d7-1be5-4271-8bf0-7fb41b314fdf tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:27.567043 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:27.567621 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:27.577240 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.577793 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.578657 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.579264 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.600827 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-085250d7-1be5-4271-8bf0-7fb41b314fdf tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:27.608388 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-085250d7-1be5-4271-8bf0-7fb41b314fdf tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1257 microversion: 2.1 time: 0.103591 Jun 23 11:12:27.610035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 557/1104] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:27 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1257 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:27.619584 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Going to try to terminate instance {{(pid=117878) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:12:27.625570 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-ab64df31-4e44-4251-a4c1-777b6000b46f req-7a3d9948-0462-4ba8-b17d-9208b23b4596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f679b64b-da38-4e32-8565-0f30aa11496f", "tag": "84b1ad85-e16c-4985-8cbb-e7bf0a1823cc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:27.635402 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ab64df31-4e44-4251-a4c1-777b6000b46f req-7a3d9948-0462-4ba8-b17d-9208b23b4596 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.636171 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-ab64df31-4e44-4251-a4c1-777b6000b46f req-7a3d9948-0462-4ba8-b17d-9208b23b4596 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.648841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-ab64df31-4e44-4251-a4c1-777b6000b46f req-7a3d9948-0462-4ba8-b17d-9208b23b4596 service nova] Creating event network-changed:84b1ad85-e16c-4985-8cbb-e7bf0a1823cc for instance f679b64b-da38-4e32-8565-0f30aa11496f on hv-cinder-84330 Jun 23 11:12:27.655069 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-ab64df31-4e44-4251-a4c1-777b6000b46f req-7a3d9948-0462-4ba8-b17d-9208b23b4596 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033855 Jun 23 11:12:27.656096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 558/1105] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:27.712736 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1ec26080-545d-4e64-b372-a5d0d2947333 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 204 len: 0 microversion: 2.1 time: 0.149480 Jun 23 11:12:27.716856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 548/1106] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:12:27 2022] DELETE /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:12:27.724520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:27.725480 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:27.733632 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.734179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.735197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:27.735731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:27.903263 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:27.913109 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-80476553-f9bf-4f29-bcd4-7fa6df11e808 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1579 microversion: 2.1 time: 0.194255 Jun 23 11:12:27.913985 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 559/1107] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:27 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1579 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:28.628971 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:28.630364 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:28.637864 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:28.638302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:28.639066 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:28.639511 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:28.703462 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:28.711002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-9fa9b5f6-f53b-4f66-996e-7cad71a736b6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1261 microversion: 2.1 time: 0.087606 Jun 23 11:12:28.711553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 549/1108] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:28 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:28.931750 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:28.932767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:28.940473 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:28.940922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:28.941689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:28.942126 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:29.071490 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:29.079347 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1db4eb53-0753-443f-a5f2-63aef2697959 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1579 microversion: 2.1 time: 0.152684 Jun 23 11:12:29.079949 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 560/1109] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:28 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:12:29.731464 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:29.732163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:29.742425 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:29.743257 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:29.744087 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:29.744530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:29.860607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:29.870228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-144e073b-5625-4682-9f35-d0bb84b03672 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1327 microversion: 2.1 time: 0.145848 Jun 23 11:12:29.871875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 550/1110] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:29 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:30.100712 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:30.102920 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:30.111830 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:30.112591 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:30.114366 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:30.115544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:30.651693 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:30.662900 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-3137fee1-cb4e-4378-b0b6-f09522cee669 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1579 microversion: 2.1 time: 0.568959 Jun 23 11:12:30.666746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 561/1111] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:30 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1579 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:30.888960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:30.905543 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:30.915941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:30.916734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:30.917684 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:30.918927 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:31.000042 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-4eb22b09-243c-4d78-b863-3dfd9f30f1b5 req-47c355be-4ce3-475c-ae14-04939962b921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f679b64b-da38-4e32-8565-0f30aa11496f", "name": "network-vif-deleted", "tag": "84b1ad85-e16c-4985-8cbb-e7bf0a1823cc"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:31.011406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4eb22b09-243c-4d78-b863-3dfd9f30f1b5 req-47c355be-4ce3-475c-ae14-04939962b921 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:31.012675 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-4eb22b09-243c-4d78-b863-3dfd9f30f1b5 req-47c355be-4ce3-475c-ae14-04939962b921 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:31.033255 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-4eb22b09-243c-4d78-b863-3dfd9f30f1b5 req-47c355be-4ce3-475c-ae14-04939962b921 service nova] Creating event network-vif-deleted:84b1ad85-e16c-4985-8cbb-e7bf0a1823cc for instance f679b64b-da38-4e32-8565-0f30aa11496f on hv-cinder-84330 Jun 23 11:12:31.040429 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-4eb22b09-243c-4d78-b863-3dfd9f30f1b5 req-47c355be-4ce3-475c-ae14-04939962b921 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046012 Jun 23 11:12:31.041288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 562/1112] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:12:31.146289 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:31.157600 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-68ace766-52fa-4731-9bc3-b1aae680ca36 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.272537 Jun 23 11:12:31.158179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 551/1113] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:30 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:31.685016 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:31.686460 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:31.694080 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:31.694528 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:31.695339 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:31.695835 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:31.764089 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:31.772704 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-82e1245c-e70b-4039-8187-aebc6f846b7c tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1392 microversion: 2.1 time: 0.093438 Jun 23 11:12:31.773715 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 563/1114] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:31 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1392 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:12:32.178564 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:32.179227 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:32.185844 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:32.186307 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:32.187078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:32.187519 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:32.324329 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:32.332531 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-63007675-56bb-4b58-af02-c55bd7070866 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.158007 Jun 23 11:12:32.333729 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 552/1115] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:32 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:32.793169 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:32.794713 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:32.802690 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:32.803234 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:32.804132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:32.804594 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:32.868218 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:32.875702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-0d9b610c-38c7-41d1-8bca-fc78cfbb8552 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1392 microversion: 2.1 time: 0.088162 Jun 23 11:12:32.876263 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 564/1116] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:32 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1392 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:33.351494 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:33.352577 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:33.374295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:33.377118 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:33.378115 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:33.380159 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:33.517004 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:33.525327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-87c74a8b-587f-457c-964e-78787d5cfa7d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.178715 Jun 23 11:12:33.526093 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 553/1117] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:33 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:33.893252 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:33.893844 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:33.901997 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:33.902794 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:33.903813 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:33.904447 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:33.973743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:33.981697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-72736925-6a0f-4085-941d-86d8cc18d5fd tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1392 microversion: 2.1 time: 0.092448 Jun 23 11:12:33.982365 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 565/1118] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:33 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1392 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:34.542957 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:34.544988 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:34.553107 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:34.553649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:34.554877 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:34.555395 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:34.700167 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:34.709431 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2bdb3f32-3f34-4d15-85e7-918a09a9fbb6 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.170336 Jun 23 11:12:34.718896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 554/1119] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:34 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:35.000634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:35.001996 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:35.010320 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:35.010944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:35.011758 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:35.012377 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:35.081927 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:35.090097 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-046113b9-e9b6-4e51-b75b-05e0807b1a34 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1392 microversion: 2.1 time: 0.093960 Jun 23 11:12:35.090661 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 566/1120] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:34 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1392 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:35.727053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:35.727956 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:35.734861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:35.735596 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:35.736633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:35.737289 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:35.873186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:35.886231 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8edd1471-0403-4b7a-b142-292e858f8839 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.163541 Jun 23 11:12:35.887225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 555/1121] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:35 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:36.106317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:36.106967 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:36.113553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:36.113995 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:36.115011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:36.115759 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:36.182330 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:36.190155 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d25cc37f-6c96-44a5-8d1a-2649aa70c320 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1392 microversion: 2.1 time: 0.087667 Jun 23 11:12:36.190931 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 567/1122] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:36 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:36.904488 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:36.905711 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:36.912607 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:36.913068 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:36.913856 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:36.914295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:37.075234 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:37.083201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-55fabf9c-2bc7-4c6e-8637-f5b632fd1240 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.182586 Jun 23 11:12:37.084196 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 556/1123] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:36 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:37.207756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:37.209202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:37.215881 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:37.216326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:37.217088 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:37.217518 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:37.283335 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:37.294100 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-4e883d17-3cb2-439f-8f03-12fb5c3db59f tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1392 microversion: 2.1 time: 0.090104 Jun 23 11:12:37.294667 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 568/1124] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:37 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1392 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:38.100936 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:38.101551 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:38.103514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:38.104377 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=6 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:38.110899 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:38.111346 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:38.112135 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:38.112575 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:38.239017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:38.246295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-47509669-59b4-44f6-a8b7-c85f5a20e8c1 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.149217 Jun 23 11:12:38.246842 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 557/1125] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:38 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:38.311078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:38.311809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:38.313886 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell0:SELECT=6 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:38.320641 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:38.321084 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:38.321847 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:38.322275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:38.389173 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8da2142b9e4751b436cfd4920587a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fccc592269f433b99c2d13dad5e8e39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:38.397432 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-887cad9f-4b62-47af-9b33-14997ebeb8a8 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 200 len: 1225 microversion: 2.1 time: 0.090406 Jun 23 11:12:38.397994 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 569/1126] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:38 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:38.859179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-e3ff8309-fd01-4270-8cdf-3188ce4b37d4 req-77b194a4-8d4c-4614-802e-d3bd349dfab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:38.868767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-e3ff8309-fd01-4270-8cdf-3188ce4b37d4 req-77b194a4-8d4c-4614-802e-d3bd349dfab5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:38.869359 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-e3ff8309-fd01-4270-8cdf-3188ce4b37d4 req-77b194a4-8d4c-4614-802e-d3bd349dfab5 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:38.873473 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:38.882409 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-e3ff8309-fd01-4270-8cdf-3188ce4b37d4 req-77b194a4-8d4c-4614-802e-d3bd349dfab5 service nova] Creating event network-changed:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:12:38.887691 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-e3ff8309-fd01-4270-8cdf-3188ce4b37d4 req-77b194a4-8d4c-4614-802e-d3bd349dfab5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031923 Jun 23 11:12:38.888353 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 558/1127] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:39.264086 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:39.264767 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:39.271870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.272484 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.273386 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.274198 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.415527 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:39.416408 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:39.417174 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: f679b64b-da38-4e32-8565-0f30aa11496f] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:39.423145 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5321039e-7762-4af7-83f7-086ba84903ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.163248 Jun 23 11:12:39.424053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 570/1128] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:39 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:39.435034 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.435886 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.437285 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.438077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.455598 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] HTTP exception thrown: Instance f679b64b-da38-4e32-8565-0f30aa11496f could not be found. Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Request method failure captured: Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f HTTP/1.1 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiTs3EDFLedpTk3rElAAOIJxn-UfNxTeaIOWo6NQY87-0BbIhQZy3UrULU03Vif_77fqF8PADrAiw1xzoqQ6XbB_iCYTzn7vq-KSWsdWUkJ6ynNOI71W_fLQjdD_BbUEZMQc0ijEFz11dE9QSz4SxpLKwJeUQnxW7YGOBa8zvnq624 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:12:39.457302 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1fccc592269f433b99c2d13dad5e8e39", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 8f8da2142b9e4751b436cfd4920587a0 Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance f679b64b-da38-4e32-8565-0f30aa11496f could not be found. Jun 23 11:12:39.459573 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': 'f679b64b-da38-4e32-8565-0f30aa11496f'} Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f679b64b-da38-4e32-8565-0f30aa11496f could not be found. Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:12:39.460541 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f679b64b-da38-4e32-8565-0f30aa11496f could not be found. Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f679b64b-da38-4e32-8565-0f30aa11496f could not be found. Jun 23 11:12:39.462120 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.463490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Returning 404 to user: Instance f679b64b-da38-4e32-8565-0f30aa11496f could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:12:39.463490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-f6c3eba5-bca2-4f19-9e34-2500bb7b88bc tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f" status: 404 len: 111 microversion: 2.1 time: 0.048754 Jun 23 11:12:39.463490 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 559/1129] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:39 2022] GET /compute/v2.1/servers/f679b64b-da38-4e32-8565-0f30aa11496f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:12:39.897053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:39.897551 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:39.903906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.904288 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.905048 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.905474 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.918861 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] HTTP exception thrown: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Request method failure captured: Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: DELETE /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c HTTP/1.1 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEiTs3EDFLedpTk3rElAAOIJxn-UfNxTeaIOWo6NQY87-0BbIhQZy3UrULU03Vif_77fqF8PADrAiw1xzoqQ6XbB_iCYTzn7vq-KSWsdWUkJ6ynNOI71W_fLQjdD_BbUEZMQc0ijEFz11dE9QSz4SxpLKwJeUQnxW7YGOBa8zvnq624 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:12:39.920529 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1fccc592269f433b99c2d13dad5e8e39", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 8f8da2142b9e4751b436cfd4920587a0 Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.922210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '6f49b10a-300a-4cca-bc81-35841bde257c'} Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:12:39.923261 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.924871 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.927314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Returning 404 to user: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:12:39.927314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5d4f161b-7b40-49c1-8fd3-1ee00e09efd2 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 404 len: 111 microversion: 2.1 time: 0.029361 Jun 23 11:12:39.927314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 571/1130] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:12:39 2022] DELETE /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:39.931499 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:39.932152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] [instance: 6f49b10a-300a-4cca-bc81-35841bde257c] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:39.938184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.938639 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.939405 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:39.939881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:39.953909 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] HTTP exception thrown: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Request method failure captured: Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c HTTP/1.1 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEiTs3EDFLedpTk3rElAAOIJxn-UfNxTeaIOWo6NQY87-0BbIhQZy3UrULU03Vif_77fqF8PADrAiw1xzoqQ6XbB_iCYTzn7vq-KSWsdWUkJ6ynNOI71W_fLQjdD_BbUEZMQc0ijEFz11dE9QSz4SxpLKwJeUQnxW7YGOBa8zvnq624 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:12:39.955410 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1fccc592269f433b99c2d13dad5e8e39", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1fccc592269f433b99c2d13dad5e8e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 1fccc592269f433b99c2d13dad5e8e39 Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-TestVolumeBootPattern-998316529 Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 8f8da2142b9e4751b436cfd4920587a0 Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-TestVolumeBootPattern-998316529-project Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.957035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '6f49b10a-300a-4cca-bc81-35841bde257c'} Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:12:39.958090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. Jun 23 11:12:39.959608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:12:39.961074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Returning 404 to user: Instance 6f49b10a-300a-4cca-bc81-35841bde257c could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:12:39.961074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4ad60a0d-a5e0-471d-ae50-059a19085d08 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c" status: 404 len: 111 microversion: 2.1 time: 0.030228 Jun 23 11:12:39.961074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 560/1131] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:39 2022] GET /compute/v2.1/servers/6f49b10a-300a-4cca-bc81-35841bde257c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:40.440681 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:40.441284 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:40.448364 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:40.448744 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:40.449487 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:40.449911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:40.574629 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:40.578041 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=100 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:40.582803 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2d4652ab-1bb9-48d3-ba35-5998315103f4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.146068 Jun 23 11:12:40.583956 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 572/1132] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:40 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:41.248122 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-161531a9-ace2-4a22-b7cf-60069fddcec7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] Calling method '.version_select at 0x7f089c754ca0>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:41.268151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-161531a9-ace2-4a22-b7cf-60069fddcec7 tempest-TestVolumeBootPattern-998316529 tempest-TestVolumeBootPattern-998316529-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-789488599" status: 202 len: 0 microversion: 2.1 time: 0.023703 Jun 23 11:12:41.268708 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 561/1133] 10.222.0.65 () {58 vars in 1259 bytes} [Thu Jun 23 11:12:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-789488599 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:12:41.600472 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:41.601078 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:41.607817 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:41.608259 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:41.609031 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:41.609440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:41.735987 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:41.743317 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8d64d337-09b9-4034-8b76-b08bd1c72b18 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.147899 Jun 23 11:12:41.744127 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 573/1134] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:41 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:42.760696 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:42.761320 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:42.768399 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:42.768853 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:42.769637 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:42.770076 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:42.998860 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:43.006213 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-b3e026ae-bea9-4300-bf36-519033a5f6e4 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.249971 Jun 23 11:12:43.006766 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 562/1135] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:42 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:44.023127 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:44.023775 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:44.030578 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:44.031024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:44.031845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:44.032274 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:44.170731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:44.178830 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-20463606-5757-4328-b061-d96d02765b3e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.160066 Jun 23 11:12:44.179471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 574/1136] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:44 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:45.197243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:45.197892 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:45.205279 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:45.205995 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:45.206857 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:45.207388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:45.323747 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-c34f82bd-775f-490e-b6f7-6c6c859e6fbe req-0433d915-d9c4-42e2-a0fd-b93e61503a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "name": "network-vif-plugged", "status": "completed", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:45.335789 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c34f82bd-775f-490e-b6f7-6c6c859e6fbe req-0433d915-d9c4-42e2-a0fd-b93e61503a41 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:45.336756 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-c34f82bd-775f-490e-b6f7-6c6c859e6fbe req-0433d915-d9c4-42e2-a0fd-b93e61503a41 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:45.349623 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-c34f82bd-775f-490e-b6f7-6c6c859e6fbe req-0433d915-d9c4-42e2-a0fd-b93e61503a41 service nova] Creating event network-vif-plugged:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:12:45.355361 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-c34f82bd-775f-490e-b6f7-6c6c859e6fbe req-0433d915-d9c4-42e2-a0fd-b93e61503a41 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Jun 23 11:12:45.356283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 575/1137] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:12:45.371295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:45.382149 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-05a12d21-49c9-46e8-bd32-7a1b942ae506 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.189328 Jun 23 11:12:45.383635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 563/1138] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:45 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:46.402024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:46.402827 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:46.409440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:46.410129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:46.410902 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:46.411344 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:46.560484 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:46.568544 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d67d8888-4c08-4e75-a316-e28bcbcdd552 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1357 microversion: 2.1 time: 0.171653 Jun 23 11:12:46.569105 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 576/1139] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:46 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:47.585614 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:47.586324 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:47.593469 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:47.593921 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:47.594688 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:47.595121 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:47.732630 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:47.740720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a0269e38-4da5-470a-a83e-94881df15e4c tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1546 microversion: 2.1 time: 0.158823 Jun 23 11:12:47.741221 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 564/1140] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:47 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:47.757128 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:47.757743 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:47.764209 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:47.764648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:47.765407 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:47.765838 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:47.910625 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:47.918693 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d2498a55-a7a0-4116-84a0-4976cfa3677f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1546 microversion: 2.1 time: 0.165992 Jun 23 11:12:47.919260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 577/1141] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:47 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:47.935893 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:47.939451 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:47.940254 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Searching by: {'deleted': False, 'project_id': '0d0d343d1ec648a981cc8d7910b92401'} {{(pid=117878) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 11:12:47.946790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:47.947369 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:47.948201 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:47.948635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:48.042720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.multi_cell_list [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117878) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 11:12:48.141808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-033b5a65-b7de-4166-9766-8d753520ceab tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210252 Jun 23 11:12:48.142232 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 565/1142] 10.222.0.65 () {58 vars in 1124 bytes} [Thu Jun 23 11:12:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:48.152798 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:48.153400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:48.159481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:48.160191 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:48.161020 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:48.162015 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:48.344520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:48.352488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8e2b6692-6a1d-486b-9ece-46d2ffed47bd tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1546 microversion: 2.1 time: 0.203766 Jun 23 11:12:48.353053 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 578/1143] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:48 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:49.905981 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94dc3aa2-43c3-4b52-8346-4219389f32c3"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:49.907103 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:49.909525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:49.915349 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:49.915829 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:49.916591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:49.917030 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:50.168457 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-316db639-008e-472a-bf40-d727773b5e5f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266225 Jun 23 11:12:50.169045 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 566/1144] 10.222.0.65 () {60 vars in 1322 bytes} [Thu Jun 23 11:12:49 2022] POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:12:57.694923 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:12:57.695535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:12:57.697854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:57.703118 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:57.703558 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:57.704946 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:57.705381 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:57.836740 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:12:57.844655 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7523dbcb-6dfd-47f3-8ff0-7c50e836d28f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1592 microversion: 2.1 time: 0.153537 Jun 23 11:12:57.845210 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 579/1145] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:12:57 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1592 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:12:59.780552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell0:SELECT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:59.923545 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-9dc534ef-75b2-4441-b3ee-30e354f4c5d0 req-bb3748bf-3c16-4d4a-8409-d2aa2de0ef8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:12:59.933261 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-9dc534ef-75b2-4441-b3ee-30e354f4c5d0 req-bb3748bf-3c16-4d4a-8409-d2aa2de0ef8d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:12:59.933773 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-9dc534ef-75b2-4441-b3ee-30e354f4c5d0 req-bb3748bf-3c16-4d4a-8409-d2aa2de0ef8d service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:12:59.950941 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-9dc534ef-75b2-4441-b3ee-30e354f4c5d0 req-bb3748bf-3c16-4d4a-8409-d2aa2de0ef8d service nova] Creating event network-changed:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:12:59.957380 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-9dc534ef-75b2-4441-b3ee-30e354f4c5d0 req-bb3748bf-3c16-4d4a-8409-d2aa2de0ef8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178153 Jun 23 11:12:59.958166 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 567/1146] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:13:00.845380 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1053785723"}} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:13:00.845918 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:00.853214 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:00.853661 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:00.854420 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:00.854853 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:00.988502 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.network.security_group_api [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Adding security group 7432c2c0-01fd-4d60-bde4-a7e703e98b04 to port 68172eb8-f026-4e28-93da-403c54cb5408 Jun 23 11:13:01.327689 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a5797b9a-d2f0-4372-930a-f58848a1d751 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/action" status: 202 len: 0 microversion: 2.1 time: 0.486583 Jun 23 11:13:01.329340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 580/1147] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:13:00 2022] POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:13:01.338896 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:01.340222 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:01.347762 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:01.348252 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:01.349045 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:01.349507 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:01.514467 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:01.525618 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7bbff8f3-c737-4fcd-b99b-d8a6d4aa220d tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1757 microversion: 2.1 time: 0.191570 Jun 23 11:13:01.527681 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 568/1148] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:01 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:01.973836 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-9a639258-7278-40c0-a4a2-1e28136e939b req-a792731f-ef1e-4136-90f5-da84d82d71b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:13:01.982047 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9a639258-7278-40c0-a4a2-1e28136e939b req-a792731f-ef1e-4136-90f5-da84d82d71b9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:01.982569 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-9a639258-7278-40c0-a4a2-1e28136e939b req-a792731f-ef1e-4136-90f5-da84d82d71b9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:01.994181 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-9a639258-7278-40c0-a4a2-1e28136e939b req-a792731f-ef1e-4136-90f5-da84d82d71b9 service nova] Creating event network-changed:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:13:01.999153 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-9a639258-7278-40c0-a4a2-1e28136e939b req-a792731f-ef1e-4136-90f5-da84d82d71b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029516 Jun 23 11:13:01.999751 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 581/1149] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:13:23.995019 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:13:23.996055 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:23.998551 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=5 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:23.999209 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:24.005287 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:24.005728 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:24.006487 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:24.006922 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:24.079213 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-fb2e4c60-f6da-4bc4-a977-fe5770798db3 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/action" status: 202 len: 0 microversion: 2.1 time: 0.087675 Jun 23 11:13:24.080053 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 569/1150] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:13:23 2022] POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:13:24.089166 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:24.089864 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:24.093534 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=5 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:24.094371 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=44 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:24.098603 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:24.098928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:24.099764 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:24.100267 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:24.249922 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:24.258467 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2308302a-b660-4487-9d0c-1481063a9648 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1749 microversion: 2.1 time: 0.173429 Jun 23 11:13:24.259023 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 582/1151] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:24 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:25.277163 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:25.277859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:25.284437 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:25.284881 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:25.285635 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:25.286072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:25.428734 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:25.436649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7c241f27-5e40-461c-81ae-5b9ed289fa87 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.164566 Jun 23 11:13:25.437211 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 570/1152] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:25 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:26.455506 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:26.456179 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:26.462197 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:26.462643 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:26.463400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:26.463859 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:26.599455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:26.607303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-10f8e783-3675-4e36-9275-4d178ae4bef7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.155864 Jun 23 11:13:26.607891 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 583/1153] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:26 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:27.628125 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:27.628125 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:27.631623 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:27.632091 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:27.632871 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:27.633295 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:27.772054 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:27.780189 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6c215fb6-e451-4f49-8389-796c41245a71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.159549 Jun 23 11:13:27.780745 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 571/1154] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:27 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:28.797891 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:28.798495 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:28.805556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:28.805992 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:28.806733 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:28.807156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:28.947914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:28.955794 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-47b91920-99e9-45ef-8807-825f3817637f tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.161744 Jun 23 11:13:28.956346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 584/1155] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:28 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:29.972953 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:29.973543 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:29.980526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:29.981001 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:29.981767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:29.982203 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:30.125009 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:30.133591 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ed0d3426-d857-4f6f-b24b-3aa296b1da71 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.163878 Jun 23 11:13:30.134151 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 572/1156] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:29 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:31.150241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:31.150872 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:31.157520 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:31.157959 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:31.158708 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:31.159130 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:31.298061 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:31.306793 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1a64ab0a-0c07-424d-b143-ee38afebc70a tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.160454 Jun 23 11:13:31.307352 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 585/1157] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:31 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:32.324342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:32.324972 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:32.331344 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:32.331817 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:32.332565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:32.332991 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:32.473938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:32.481808 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-da7e700f-4dd3-4962-83ab-aeb70e7c4668 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.161775 Jun 23 11:13:32.482369 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 573/1158] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:32 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:33.499120 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:33.499806 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:33.506287 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:33.506735 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:33.507493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:33.508576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:33.647338 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:33.655934 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ab9c8cab-76c4-4106-8b4b-81a08f0ce9e7 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.160671 Jun 23 11:13:33.656510 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 586/1159] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:33 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:34.673601 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:34.674206 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:34.681330 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:34.681777 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:34.682530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:34.682962 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:34.821486 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:34.829422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-1cc019fd-12bf-4eab-9185-c912c0149fb2 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.159692 Jun 23 11:13:34.829985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 574/1160] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:34 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:35.846230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:35.846841 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:35.853471 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:35.853912 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:35.854665 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:35.855102 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:35.998301 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:36.007096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c2d1df6a-de2a-476d-a2c4-5edba50a28ef tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.164720 Jun 23 11:13:36.007677 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 587/1161] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:35 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:37.025161 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:37.025774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:37.032565 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:37.033022 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:37.033789 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:37.034228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:37.176079 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:37.184005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-a51b7495-361c-45cb-b8f8-08fb695a11a9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.163206 Jun 23 11:13:37.184581 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 575/1162] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:37 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:38.201163 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:38.201769 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:38.208282 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:38.208725 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:38.209483 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:38.209914 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:38.348799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:38.357117 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2a55d7c7-35fd-4f6b-ada0-0dcb67c49651 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.159848 Jun 23 11:13:38.357674 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 588/1163] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:38 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:39.374391 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:39.374955 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:39.381697 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:39.382139 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:39.383516 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:39.384011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:39.521038 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:39.529204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-798dbf13-22a7-4ab3-a62c-67258cb0b419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.158751 Jun 23 11:13:39.529759 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 576/1164] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:39 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:40.546113 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:40.546721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:40.553215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:40.553662 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:40.554411 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:40.554842 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:40.696308 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:40.704249 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ecc949cf-efa5-4403-b0bd-82d15ebfd419 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1754 microversion: 2.1 time: 0.162025 Jun 23 11:13:40.704809 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 589/1165] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:40 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:40.770214 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:13:40.770765 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:40.777496 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:40.777947 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:40.778738 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:40.779175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:40.801188 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lazy-loading 'flavor' on Instance uuid 3fef873c-b5da-4857-b0d3-3fc5a5fc155d {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:13:40.870004 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2075bb32-a927-49f8-b918-30775b4d5112 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "POST /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d/action" status: 202 len: 0 microversion: 2.1 time: 0.103467 Jun 23 11:13:40.870923 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 577/1166] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:13:40 2022] POST /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:13:40.878980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:40.879586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:40.886220 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:40.886669 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:40.887415 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:40.887870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:41.018475 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:41.026024 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-73a41e82-3ea8-46af-99ac-e32e2e0f0bd1 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.151027 Jun 23 11:13:41.026585 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 590/1167] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:40 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:41.721940 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:41.722556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:41.729357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:41.729803 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:41.730562 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:41.730996 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:41.872017 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:41.879862 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7f6fa14a-1b02-4b94-a823-7cd9712b09d9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1757 microversion: 2.1 time: 0.162259 Jun 23 11:13:41.880424 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 578/1168] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:41 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:42.043521 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:42.044183 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:42.050634 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:42.051079 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:42.051867 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:42.052300 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:42.182714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:42.190139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1cde704a-f402-48d1-acdf-0e2042e615e7 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.150465 Jun 23 11:13:42.190697 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 591/1169] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:42 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:43.207677 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:43.208316 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:43.214840 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:43.215288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:43.216078 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:43.216516 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:43.342261 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:43.349710 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-5f8471dd-8635-49bc-8c5c-d5ca6860dc61 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.145826 Jun 23 11:13:43.350204 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 579/1170] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:43 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:44.367148 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:44.368240 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:44.374706 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:44.375151 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:44.375943 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:44.376372 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:44.504298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:44.514157 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6ff60edf-6609-496a-a8b2-4c2bc3f722eb tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.151017 Jun 23 11:13:44.514721 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 592/1171] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:44 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:45.531910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:45.532530 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:45.539073 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:45.539526 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:45.540324 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:45.540760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:45.673427 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:45.680928 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-61446dd4-1fa6-4313-8f3f-ff500e60d081 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.153158 Jun 23 11:13:45.681478 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 580/1172] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:45 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:46.697870 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:46.698389 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:46.704977 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:46.705423 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:46.706175 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:46.706606 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:46.832025 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:46.840072 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-65937014-0d66-4cc0-b23f-066f6b2dcdad tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.146094 Jun 23 11:13:46.840635 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 593/1173] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:46 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:47.857553 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:47.858181 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:47.864743 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:47.865186 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:47.865938 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:47.866366 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:47.998847 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:48.006300 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e0e7b173-47bd-4368-a2c8-5af80e907470 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.152573 Jun 23 11:13:48.006855 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 581/1174] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:47 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:49.023103 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:49.023731 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:49.030488 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:49.030926 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:49.031694 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:49.032135 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:49.162116 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:49.169571 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-97b4d483-9bee-4115-9818-13f30503fc91 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.150438 Jun 23 11:13:49.170131 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 594/1175] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:49 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:50.186589 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:50.187205 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:50.194012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:50.194460 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:50.195225 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:50.195682 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:50.214772 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:50.326470 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:50.334077 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-4c49635c-2ee8-455b-b027-ee4886498803 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.151380 Jun 23 11:13:50.334633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 582/1176] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:50 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:51.351732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:51.352281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:51.359326 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:51.359811 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:51.360580 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:51.361011 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:51.492044 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:51.500409 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-d6c593a4-263c-44f5-a3a3-301719d06cd9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.152659 Jun 23 11:13:51.500973 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 595/1177] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:51 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:52.517200 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:52.517812 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:52.524446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:52.524897 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:52.526276 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:52.526718 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:52.658597 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:52.666051 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-ac4fe2b6-e508-4d7f-baef-81e1a4439b52 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.152714 Jun 23 11:13:52.666609 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 583/1178] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:52 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:53.682150 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:53.682787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:53.689152 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:53.689599 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:53.690349 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:53.690779 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:53.825994 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:53.834592 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-8cf5804a-3ec4-4cc9-96b1-822dd1ecda78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.156260 Jun 23 11:13:53.835156 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 596/1179] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:53 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:54.852342 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:54.853006 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:54.855237 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=31 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:54.860463 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:54.860918 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:54.861698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:54.862129 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:54.988195 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:54.996486 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-46e954b1-60f5-4c41-9a12-d8d6f5a86e78 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1508 microversion: 2.1 time: 0.147900 Jun 23 11:13:54.997172 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 584/1180] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:54 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:55.013583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:13:55.014148 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:55.016931 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=31 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:55.022493 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:55.022930 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:55.023696 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:55.024129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:55.028241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=91 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:55.095464 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [9f17767b-e5c7-4ffa-830e-d028ff3f7e35] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:13:56.102658 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [9f17767b-e5c7-4ffa-830e-d028ff3f7e35] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 38940. Jun 23 11:13:56.105716 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-92b43d31-a07a-4dc8-8ee3-10ed8521c2ba tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "POST /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d/action" status: 202 len: 0 microversion: 2.1 time: 1.096875 Jun 23 11:13:56.106319 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 597/1181] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:13:55 2022] POST /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d/action => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:13:56.114402 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:56.115012 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:56.121534 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:56.121983 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:56.122746 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:56.123194 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:56.252594 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:56.260774 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-e21ed900-9554-45d9-ae34-13a95914cdee tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1516 microversion: 2.1 time: 0.150159 Jun 23 11:13:56.261331 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 585/1182] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:56 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:57.278688 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:57.279289 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:57.285164 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:57.285601 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:57.286346 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:57.286770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:57.416746 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:57.424298 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-fff84833-753e-48ac-87b2-a0284fd7b04b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1518 microversion: 2.1 time: 0.150345 Jun 23 11:13:57.425063 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 598/1183] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:57 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:13:57.666097 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-3cdf99b6-f5ed-4b48-9dda-4ade9af5d988 req-7dfa01d0-a3f7-4d6d-b245-166d6cbd67fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "name": "network-vif-unplugged", "status": "completed", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:13:57.674319 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-3cdf99b6-f5ed-4b48-9dda-4ade9af5d988 req-7dfa01d0-a3f7-4d6d-b245-166d6cbd67fd service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:57.674764 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-3cdf99b6-f5ed-4b48-9dda-4ade9af5d988 req-7dfa01d0-a3f7-4d6d-b245-166d6cbd67fd service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:57.687179 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.compute.server_external_events [req-3cdf99b6-f5ed-4b48-9dda-4ade9af5d988 req-7dfa01d0-a3f7-4d6d-b245-166d6cbd67fd service nova] Unable to find a host for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d. Dropping event network-vif-unplugged {{(pid=117878) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 11:13:57.688422 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-3cdf99b6-f5ed-4b48-9dda-4ade9af5d988 req-7dfa01d0-a3f7-4d6d-b245-166d6cbd67fd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080688 Jun 23 11:13:57.689011 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 586/1184] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 11:13:58.441598 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:58.442236 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:58.448639 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:58.449313 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:58.449843 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:58.450283 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:58.578375 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:58.586022 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-280decab-dd4f-4c04-8e4a-28e56f25f49d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.148411 Jun 23 11:13:58.586586 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 599/1185] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:58 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:13:59.603401 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:13:59.604035 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:13:59.610438 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:59.610882 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:59.611629 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:13:59.612152 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:13:59.740700 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:13:59.748642 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-2a0e6d67-5e77-44e2-91dd-2ad634296cdc tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.149092 Jun 23 11:13:59.749192 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 587/1186] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:13:59 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:00.766583 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:00.767195 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:00.773727 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:00.774172 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:00.774928 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:00.775430 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:00.901303 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:00.909009 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-c191c6ec-6c27-4445-9f81-b651189b9036 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.146403 Jun 23 11:14:00.909567 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 600/1187] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:00 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:01.925007 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:01.925608 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:01.932560 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:01.933002 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:01.933750 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:01.934175 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:02.064767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:02.072193 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-38236c49-edd6-44e8-bd70-c7d524657b9a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.150976 Jun 23 11:14:02.072754 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 588/1188] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:01 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:03.089787 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:03.090400 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:03.097565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:03.097565 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:03.098314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:03.098748 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:03.230311 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:03.237684 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9634b64e-e471-4f87-b434-a9c8682d8490 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.152433 Jun 23 11:14:03.238244 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 601/1189] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:03 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:04.253712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:04.254327 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:04.260985 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:04.261443 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:04.262211 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:04.262649 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:04.389031 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:04.396424 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-41632519-e08c-426c-b9ff-40e7ec5cc424 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.146575 Jun 23 11:14:04.396978 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 589/1190] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:04 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:05.412963 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:05.413568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:05.420035 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:05.420481 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:05.421230 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:05.421659 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:05.546854 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:05.554225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2fabe1e7-a99a-4041-99ee-6721cf00805f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.145126 Jun 23 11:14:05.560254 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 602/1191] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:05 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:06.571435 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:06.572070 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:06.579328 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:06.579760 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:06.580525 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:06.580960 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:06.707420 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:06.715567 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-7b5abfea-8dbe-4a16-aa45-fa5aeb96be50 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.147928 Jun 23 11:14:06.724858 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 590/1192] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:06 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:07.733215 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:07.733833 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:07.740437 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:07.740888 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:07.741656 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:07.742091 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:07.878458 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:07.885861 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-a4d5cf50-ad35-4010-93a9-4435ae7c183d tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.157285 Jun 23 11:14:07.886412 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 603/1193] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:07 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:08.902228 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:08.902859 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:08.909617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:08.910096 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:08.910861 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:08.911313 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:09.041698 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:09.049656 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-6390a9dd-e8c3-446f-a7bf-d3990105f6e9 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.151233 Jun 23 11:14:09.050209 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 591/1194] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:08 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:09.698720 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-54d880e9-2d17-4b2f-b9e3-7d69dadc209f req-1dd04b9c-b770-43cb-b24f-87c577ce167f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "name": "network-vif-plugged", "status": "completed", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:14:09.709129 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-54d880e9-2d17-4b2f-b9e3-7d69dadc209f req-1dd04b9c-b770-43cb-b24f-87c577ce167f service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:09.709607 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-54d880e9-2d17-4b2f-b9e3-7d69dadc209f req-1dd04b9c-b770-43cb-b24f-87c577ce167f service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:09.722225 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-54d880e9-2d17-4b2f-b9e3-7d69dadc209f req-1dd04b9c-b770-43cb-b24f-87c577ce167f service nova] Creating event network-vif-plugged:72bdff1f-006b-46d7-8a00-abb368b12ebb for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d on hv-cinder-84330 Jun 23 11:14:09.727238 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-54d880e9-2d17-4b2f-b9e3-7d69dadc209f req-1dd04b9c-b770-43cb-b24f-87c577ce167f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032275 Jun 23 11:14:09.727865 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 604/1195] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:14:10.066772 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:10.067391 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:10.074080 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:10.075180 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:10.075966 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:10.076395 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:10.215243 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:10.222652 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-98743e61-b98a-4a20-8071-028b03e2a59f tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1574 microversion: 2.1 time: 0.159701 Jun 23 11:14:10.223208 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 592/1196] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:10 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:11.241073 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:11.241757 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:11.247860 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:11.248297 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:11.249043 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:11.249466 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:11.376728 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:11.384045 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-44014455-3a88-471e-808a-3ba4db84cfde tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1561 microversion: 2.1 time: 0.147710 Jun 23 11:14:11.384597 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 605/1197] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:11 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:14.987388 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1053785723"}} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:14:14.988014 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:14.994472 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:14.994927 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:14.995874 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:14.996244 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:15.119767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.network.security_group_api [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Removing security group 7432c2c0-01fd-4d60-bde4-a7e703e98b04 from port 68172eb8-f026-4e28-93da-403c54cb5408 Jun 23 11:14:15.446446 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-c8b641bd-c231-457e-a9da-15ca7a3037f5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/action" status: 202 len: 0 microversion: 2.1 time: 0.463521 Jun 23 11:14:15.450325 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 593/1198] 10.222.0.65 () {60 vars in 1277 bytes} [Thu Jun 23 11:14:14 2022] POST /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:14:15.549244 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-125857fb-bfa1-4510-a4f3-9f9f05bb720e req-6290769f-5e8b-4c1f-8fd9-afd392fbf599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:14:15.558575 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-125857fb-bfa1-4510-a4f3-9f9f05bb720e req-6290769f-5e8b-4c1f-8fd9-afd392fbf599 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:15.559341 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-125857fb-bfa1-4510-a4f3-9f9f05bb720e req-6290769f-5e8b-4c1f-8fd9-afd392fbf599 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:15.572732 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-125857fb-bfa1-4510-a4f3-9f9f05bb720e req-6290769f-5e8b-4c1f-8fd9-afd392fbf599 service nova] Creating event network-changed:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:14:15.577944 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-125857fb-bfa1-4510-a4f3-9f9f05bb720e req-6290769f-5e8b-4c1f-8fd9-afd392fbf599 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123314 Jun 23 11:14:15.579440 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 606/1199] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:14:17.126832 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:17.127332 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:17.133318 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:17.133763 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:17.134510 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:17.134946 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:17.216556 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.objects.instance [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lazy-loading 'services' on Instance uuid 49ffd473-8630-4fa2-b924-3180354777f6 {{(pid=117878) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:14:17.289651 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-8d03a1d9-829d-49cc-9434-3684cbd01172 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments/94dc3aa2-43c3-4b52-8346-4219389f32c3" status: 202 len: 0 microversion: 2.1 time: 0.167273 Jun 23 11:14:17.290236 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 594/1200] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:14:17 2022] DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments/94dc3aa2-43c3-4b52-8346-4219389f32c3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:14:17.300394 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:17.301465 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:17.307845 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:17.308576 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:17.309406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:17.310068 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:17.339785 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-6f03d2c4-f227-4aa6-a53d-2fb7f046bbea tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Jun 23 11:14:17.340610 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 607/1201] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:14:17 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:14:17.593249 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-f31badcf-c21a-4dc0-9a25-390954e46524 req-69ccf08b-3d54-4b89-bc58-d971617287e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:14:17.602220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-f31badcf-c21a-4dc0-9a25-390954e46524 req-69ccf08b-3d54-4b89-bc58-d971617287e9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:17.602657 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-f31badcf-c21a-4dc0-9a25-390954e46524 req-69ccf08b-3d54-4b89-bc58-d971617287e9 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:17.613154 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-f31badcf-c21a-4dc0-9a25-390954e46524 req-69ccf08b-3d54-4b89-bc58-d971617287e9 service nova] Creating event network-changed:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:14:17.617875 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-f31badcf-c21a-4dc0-9a25-390954e46524 req-69ccf08b-3d54-4b89-bc58-d971617287e9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028758 Jun 23 11:14:17.618659 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 595/1202] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:14:18.352417 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:18.353281 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:18.360334 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:18.360780 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:18.361535 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:18.361971 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:18.390013 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-ce43be86-fb2c-4e83-b6fd-38ec2eaffb13 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041682 Jun 23 11:14:18.390556 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 608/1203] 10.222.0.65 () {58 vars in 1301 bytes} [Thu Jun 23 11:14:18 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:14:18.401367 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:18.401948 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:18.408407 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:18.408854 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:18.409611 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:18.410044 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:18.481798 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] HTTP exception thrown: Instance 49ffd473-8630-4fa2-b924-3180354777f6 is not attached to volume 94dc3aa2-43c3-4b52-8346-4219389f32c3 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Request method failure captured: Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments/94dc3aa2-43c3-4b52-8346-4219389f32c3 HTTP/1.1 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEqLhyiNtJURcZAcu_aODq3fy0m7MGBcJN27kSU5O5B8JtiQq9IgKWgR9WB43DWNzVdiIL0p255QwtwqAxiBEy4bvt81dyXRfChxIx1aFJXtnuZC9bdVeI_S0SmZSPTkCneFO-VJvvV8XryNKYnNOs8sT-OdRjs0kNDbDv-omfVuoPY Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: 0d0d343d1ec648a981cc8d7910b92401 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-TestMinimumBasicScenario-1873454161 Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:14:18.484169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0d0d343d1ec648a981cc8d7910b92401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0d0d343d1ec648a981cc8d7910b92401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0d0d343d1ec648a981cc8d7910b92401", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0d0d343d1ec648a981cc8d7910b92401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-TestMinimumBasicScenario-1873454161 Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: 0d0d343d1ec648a981cc8d7910b92401 Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1873454161 Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-TestMinimumBasicScenario-1873454161-project Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 7d3495251b56423fbe694d5cb7ef4695 Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-TestMinimumBasicScenario-1873454161-project Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:14:18.486233 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 49ffd473-8630-4fa2-b924-3180354777f6 is not attached to volume 94dc3aa2-43c3-4b52-8346-4219389f32c3 Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'server_id': '49ffd473-8630-4fa2-b924-3180354777f6', 'id': '94dc3aa2-43c3-4b52-8346-4219389f32c3'} Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 94dc3aa2-43c3-4b52-8346-4219389f32c3. Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:14:18.487005 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ffd473-8630-4fa2-b924-3180354777f6 is not attached to volume 94dc3aa2-43c3-4b52-8346-4219389f32c3 Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ffd473-8630-4fa2-b924-3180354777f6 is not attached to volume 94dc3aa2-43c3-4b52-8346-4219389f32c3 Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:14:18.488648 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Returning 404 to user: Instance 49ffd473-8630-4fa2-b924-3180354777f6 is not attached to volume 94dc3aa2-43c3-4b52-8346-4219389f32c3 {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:14:18.489949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-35090a80-4504-4600-b39f-87d17a80549e tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments/94dc3aa2-43c3-4b52-8346-4219389f32c3" status: 404 len: 154 microversion: 2.1 time: 0.089467 Jun 23 11:14:18.489949 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 596/1204] 10.222.0.65 () {58 vars in 1415 bytes} [Thu Jun 23 11:14:18 2022] DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6/os-volume_attachments/94dc3aa2-43c3-4b52-8346-4219389f32c3 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:14:19.616428 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:19.616941 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:19.623314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:19.623799 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:19.624551 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:19.624980 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:19.650001 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:14:19.724866 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-1a413d4d-87d8-4f32-8bd9-2425ffe42068 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 204 len: 0 microversion: 2.1 time: 0.112023 Jun 23 11:14:19.725536 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 609/1205] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:14:19 2022] DELETE /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:14:19.734755 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:19.735394 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:19.741737 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:19.742184 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:19.742961 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:19.743398 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:19.874597 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:19.882910 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-39eec760-0e6b-4b07-9994-4ece71fdc5ca tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1552 microversion: 2.1 time: 0.152586 Jun 23 11:14:19.883471 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 597/1206] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:19 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:20.900772 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:20.901490 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:20.908906 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:20.909345 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:20.910098 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:20.910553 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:21.037316 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:21.044724 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-2bd6ff5b-deb2-4aab-974d-fd0c7c2a5629 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1552 microversion: 2.1 time: 0.148241 Jun 23 11:14:21.045284 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 610/1207] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:20 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:22.062182 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:22.063398 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [req-440384ba-a3b2-4707-b182-0a3950ef42a5 req-c37bb4de-c662-4773-aee2-c00d20fae448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ffd473-8630-4fa2-b924-3180354777f6", "name": "network-vif-deleted", "tag": "68172eb8-f026-4e28-93da-403c54cb5408"}]} {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:14:22.063869 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:22.071335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:22.071849 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:22.072633 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:22.073074 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:22.073863 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-440384ba-a3b2-4707-b182-0a3950ef42a5 req-c37bb4de-c662-4773-aee2-c00d20fae448 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:22.074306 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [req-440384ba-a3b2-4707-b182-0a3950ef42a5 req-c37bb4de-c662-4773-aee2-c00d20fae448 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:22.075964 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:14:22.087903 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.compute.server_external_events [req-440384ba-a3b2-4707-b182-0a3950ef42a5 req-c37bb4de-c662-4773-aee2-c00d20fae448 service nova] Creating event network-vif-deleted:68172eb8-f026-4e28-93da-403c54cb5408 for instance 49ffd473-8630-4fa2-b924-3180354777f6 on hv-cinder-84330 Jun 23 11:14:22.093738 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [req-440384ba-a3b2-4707-b182-0a3950ef42a5 req-c37bb4de-c662-4773-aee2-c00d20fae448 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033866 Jun 23 11:14:22.095081 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 611/1208] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:14:22.137413 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3495251b56423fbe694d5cb7ef4695', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0d343d1ec648a981cc8d7910b92401', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:14:22.145617 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-af903edb-7b62-4fca-8b60-5748db4d6d32 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 200 len: 1510 microversion: 2.1 time: 0.087678 Jun 23 11:14:22.146178 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 598/1209] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:22 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 1510 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:14:23.163302 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:23.164017 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] [instance: 49ffd473-8630-4fa2-b924-3180354777f6] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:14:23.170132 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:23.170568 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:23.171314 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:14:23.171770 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:14:23.185134 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.wsgi [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] HTTP exception thrown: Instance 49ffd473-8630-4fa2-b924-3180354777f6 could not be found. Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Request method failure captured: Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: request: GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 HTTP/1.1 Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept: application/json Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Accept-Encoding: identity Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Connection: close Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Length: 0 Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Content-Type: application/json Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Host: 10.222.0.65 Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Openstack-System-Scope: None Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: User-Agent: python-urllib3/1.26.9 Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Auth-Token: gAAAAABitEqLhyiNtJURcZAcu_aODq3fy0m7MGBcJN27kSU5O5B8JtiQq9IgKWgR9WB43DWNzVdiIL0p255QwtwqAxiBEy4bvt81dyXRfChxIx1aFJXtnuZC9bdVeI_S0SmZSPTkCneFO-VJvvV8XryNKYnNOs8sT-OdRjs0kNDbDv-omfVuoPY Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Id: None Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Domain-Name: None Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Identity-Status: Confirmed Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Is-Admin-Project: True Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Id: default Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Domain-Name: Default Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Id: 0d0d343d1ec648a981cc8d7910b92401 Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Project-Name: tempest-TestMinimumBasicScenario-1873454161 Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Role: member,reader Jun 23 11:14:23.186714 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Roles: member,reader Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0d0d343d1ec648a981cc8d7910b92401"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0d0d343d1ec648a981cc8d7910b92401"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0d0d343d1ec648a981cc8d7910b92401", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0d0d343d1ec648a981cc8d7910b92401"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant: tempest-TestMinimumBasicScenario-1873454161 Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Id: 0d0d343d1ec648a981cc8d7910b92401 Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1873454161 Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User: tempest-TestMinimumBasicScenario-1873454161-project Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Id: default Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Domain-Name: Default Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Id: 7d3495251b56423fbe694d5cb7ef4695 Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: X-User-Name: tempest-TestMinimumBasicScenario-1873454161-project Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: method: > Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: exception: Instance 49ffd473-8630-4fa2-b924-3180354777f6 could not be found. Jun 23 11:14:23.188975 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: action_args: {'id': '49ffd473-8630-4fa2-b924-3180354777f6'} Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ffd473-8630-4fa2-b924-3180354777f6 could not be found. Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:14:23.189877 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ffd473-8630-4fa2-b924-3180354777f6 could not be found. Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ffd473-8630-4fa2-b924-3180354777f6 could not be found. Jun 23 11:14:23.191170 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR nova.api.openstack.wsgi Jun 23 11:14:23.192587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Returning 404 to user: Instance 49ffd473-8630-4fa2-b924-3180354777f6 could not be found. {{(pid=117877) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:14:23.192587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-9839d5fe-1c41-41a9-b0e6-965d95ee89e9 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6" status: 404 len: 111 microversion: 2.1 time: 0.029503 Jun 23 11:14:23.192587 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 612/1210] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:14:23 2022] GET /compute/v2.1/servers/49ffd473-8630-4fa2-b924-3180354777f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:14:23.197312 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-11e427d4-3c7e-4f4a-8576-46cd766d07e5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] Calling method '.version_select at 0x7f089c8a9700>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:14:23.214973 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-11e427d4-3c7e-4f4a-8576-46cd766d07e5 tempest-TestMinimumBasicScenario-1873454161 tempest-TestMinimumBasicScenario-1873454161-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-743017024" status: 202 len: 0 microversion: 2.1 time: 0.021404 Jun 23 11:14:23.215520 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 599/1211] 10.222.0.65 () {58 vars in 1268 bytes} [Thu Jun 23 11:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-743017024 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:15:26.115335 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_cell1:SELECT=5 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:26.116108 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG dbcounter [-] [117878] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117878) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:26.116978 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:26.117821 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG dbcounter [-] [117877] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117877) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:26.122260 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:15:26.122796 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:15:26.132241 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-472fdeef-ba7b-43fc-8301-feceafc50d83 req-f715aaea-1a90-4285-af44-5d345a340228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:15:26.141703 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-472fdeef-ba7b-43fc-8301-feceafc50d83 req-f715aaea-1a90-4285-af44-5d345a340228 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:26.142149 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-472fdeef-ba7b-43fc-8301-feceafc50d83 req-f715aaea-1a90-4285-af44-5d345a340228 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:26.150096 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:26.150640 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:26.151434 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:26.151911 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:26.166356 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-472fdeef-ba7b-43fc-8301-feceafc50d83 req-f715aaea-1a90-4285-af44-5d345a340228 service nova] Creating event network-changed:72bdff1f-006b-46d7-8a00-abb368b12ebb for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d on hv-cinder-84330 Jun 23 11:15:26.171924 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-472fdeef-ba7b-43fc-8301-feceafc50d83 req-f715aaea-1a90-4285-af44-5d345a340228 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057874 Jun 23 11:15:26.175314 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 600/1212] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:15:26.180577 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Going to try to terminate instance {{(pid=117877) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:15:26.266004 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-f4e6bf92-f810-485b-9e74-3417e89e69c0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 204 len: 0 microversion: 2.1 time: 0.154737 Jun 23 11:15:26.269884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 613/1213] 10.222.0.65 () {58 vars in 1238 bytes} [Thu Jun 23 11:15:26 2022] DELETE /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:15:26.278447 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:15:26.279292 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:15:26.286267 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:26.287360 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:26.288357 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:26.288790 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:26.426199 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.policy [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117878) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:15:26.435767 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-49d6baac-5ce8-4151-95e9-0ed8840482e0 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.162860 Jun 23 11:15:26.436676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 601/1214] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:15:26 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:15:27.454239 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:15:27.454932 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:15:27.462012 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:27.462448 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:27.463216 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:27.463648 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:27.594202 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:15:27.601702 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-cc66c3b9-46ca-450f-8405-c215be95285a tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1567 microversion: 2.1 time: 0.151745 Jun 23 11:15:27.602275 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 614/1215] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:15:27 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:15:28.465000 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [req-bff0a5af-b44e-429f-9ac0-96b34c3c6503 req-d3352f32-c493-4727-bb2a-600dfefeb950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fef873c-b5da-4857-b0d3-3fc5a5fc155d", "name": "network-vif-deleted", "tag": "72bdff1f-006b-46d7-8a00-abb368b12ebb"}]} {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:15:28.473072 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-bff0a5af-b44e-429f-9ac0-96b34c3c6503 req-d3352f32-c493-4727-bb2a-600dfefeb950 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:28.473555 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [req-bff0a5af-b44e-429f-9ac0-96b34c3c6503 req-d3352f32-c493-4727-bb2a-600dfefeb950 service nova] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:28.484491 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.compute.server_external_events [req-bff0a5af-b44e-429f-9ac0-96b34c3c6503 req-d3352f32-c493-4727-bb2a-600dfefeb950 service nova] Creating event network-vif-deleted:72bdff1f-006b-46d7-8a00-abb368b12ebb for instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d on hv-cinder-84330 Jun 23 11:15:28.489552 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [req-bff0a5af-b44e-429f-9ac0-96b34c3c6503 req-d3352f32-c493-4727-bb2a-600dfefeb950 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028559 Jun 23 11:15:28.490713 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 602/1216] 10.222.0.65 () {64 vars in 1317 bytes} [Thu Jun 23 11:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:15:28.618850 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:15:28.619455 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.compute.api [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117877) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:15:28.625897 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:28.626340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:28.627100 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:28.627532 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG oslo_concurrency.lockutils [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117877) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:28.688241 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.policy [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cabfbd1c494f62b291be319781b071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8040a7c927f4d4ebff4964bc1b63ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117877) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:15:28.696406 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-5fa23d70-ef3b-4ea9-a583-7d03899f315b tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 200 len: 1218 microversion: 2.1 time: 0.081990 Jun 23 11:15:28.696965 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 615/1217] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:15:28 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:15:29.714993 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '>' {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:15:29.715716 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.compute.api [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [instance: 3fef873c-b5da-4857-b0d3-3fc5a5fc155d] Fetching instance by UUID {{(pid=117878) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:15:29.721895 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:29.722348 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:29.723113 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:15:29.723554 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG oslo_concurrency.lockutils [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Lock "39972d54-8889-44dd-a663-db2f8dbec8fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117878) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:15:29.738090 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.wsgi [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] HTTP exception thrown: Instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d could not be found. Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Request method failure captured: Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: request: GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d HTTP/1.1 Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept: application/json Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Accept-Encoding: identity Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Connection: close Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Length: 0 Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Content-Type: application/json Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Host: 10.222.0.65 Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Openstack-System-Scope: None Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: User-Agent: python-urllib3/1.26.9 Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Auth-Token: gAAAAABitEo9RUmiJGO6qeTWJEbd7dweqq866hEU-82k56jAjOOVfPlLBFsAJ5dPOjIzvE0wWUVTeAuExKuQ5iTIAwXJR_pUm0UWz3MkQnD8qZwxvL6ax4i1FKstBBupxvmrfyYr2d00-fJDV4lJxE4m52Ih5NFRuo6Meqs9goxK2Eo0tJmtFfM Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Id: None Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Domain-Name: None Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Identity-Status: Confirmed Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Is-Admin-Project: True Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Id: default Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Domain-Name: Default Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Id: c8040a7c927f4d4ebff4964bc1b63ad7 Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Project-Name: tempest-TestShelveInstance-530677782 Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Role: member,reader Jun 23 11:15:29.739726 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Roles: member,reader Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c8040a7c927f4d4ebff4964bc1b63ad7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c8040a7c927f4d4ebff4964bc1b63ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c8040a7c927f4d4ebff4964bc1b63ad7", "adminURL": "http://10.222.0.65:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c8040a7c927f4d4ebff4964bc1b63ad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant: tempest-TestShelveInstance-530677782 Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Id: c8040a7c927f4d4ebff4964bc1b63ad7 Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-Tenant-Name: tempest-TestShelveInstance-530677782 Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User: tempest-TestShelveInstance-530677782-project Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Id: default Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Domain-Name: Default Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Id: 57cabfbd1c494f62b291be319781b071 Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: X-User-Name: tempest-TestShelveInstance-530677782-project Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: method: > Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: exception: Instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d could not be found. Jun 23 11:15:29.741578 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: action_args: {'id': '3fef873c-b5da-4857-b0d3-3fc5a5fc155d'} Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: {{(pid=117878) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d could not be found. Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:15:29.742514 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d could not be found. Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d could not be found. Jun 23 11:15:29.744008 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: ERROR nova.api.openstack.wsgi Jun 23 11:15:29.745288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: DEBUG nova.api.openstack.wsgi [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Returning 404 to user: Instance 3fef873c-b5da-4857-b0d3-3fc5a5fc155d could not be found. {{(pid=117878) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:15:29.745288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO nova.api.openstack.requestlog [None req-29dbd265-636c-4f4e-a6c9-f0a2c6bd02f3 tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d" status: 404 len: 111 microversion: 2.1 time: 0.030940 Jun 23 11:15:29.745288 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: [pid: 117878|app: 0|req: 603/1218] 10.222.0.65 () {58 vars in 1235 bytes} [Thu Jun 23 11:15:29 2022] GET /compute/v2.1/servers/3fef873c-b5da-4857-b0d3-3fc5a5fc155d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:15:29.903220 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: DEBUG nova.api.openstack.wsgi [None req-7b4115a1-4d1e-4640-af59-dfb5feb9743c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] Calling method '.version_select at 0x7f089cb790d0>' {{(pid=117877) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:15:29.906636 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b4115a1-4d1e-4640-af59-dfb5feb9743c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [5476715a-8643-4bca-a0df-a6de60d46ac4] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:15:30.914265 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b4115a1-4d1e-4640-af59-dfb5feb9743c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] [5476715a-8643-4bca-a0df-a6de60d46ac4] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 39170. Jun 23 11:15:30.931884 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO nova.api.openstack.requestlog [None req-7b4115a1-4d1e-4640-af59-dfb5feb9743c tempest-TestShelveInstance-530677782 tempest-TestShelveInstance-530677782-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-91420173" status: 202 len: 0 microversion: 2.1 time: 1.032470 Jun 23 11:15:30.932456 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: [pid: 117877|app: 0|req: 616/1219] 10.222.0.65 () {58 vars in 1247 bytes} [Thu Jun 23 11:15:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-91420173 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:15:37.405169 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:15:37.405732 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:15:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:17:09.428720 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:17:09.429353 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:17:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:17:33.177938 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:17:33.178439 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Thu Jun 23 11:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:17:35.362712 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:17:35.363220 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:17:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:18:57.136149 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:18:57.136678 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Thu Jun 23 11:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:18:57.413280 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:18:57.413762 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:20:29.436975 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:20:29.437676 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:20:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:20:37.883511 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:20:37.884139 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Thu Jun 23 11:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:20:53.185763 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:20:53.186340 dv-cinder-843309-2-iscsi devstack@n-api.service[117877]: Thu Jun 23 11:20:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:20:55.370255 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:20:55.370757 dv-cinder-843309-2-iscsi devstack@n-api.service[117878]: Thu Jun 23 11:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!